00000004:00100000:2.0F:1736271490.422856:0:27667:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre-MDT0000: cli 192.168.203.38@tcp supports cksum type f7, return f7 00000100:00100000:0.0F:1736271490.422944:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131a86d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+2:1891:x1820604058961408:12345-192.168.203.38@tcp:38:ptlrpcd_rcv.0 Request processed in 39309us (39431us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271490.422959:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 604 00000100:00100000:2.0:1736271490.424145:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271490.424166:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271490.424207:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271490.424224:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058961536 00000100:00100000:3.0F:1736271490.424224:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058961472 00000100:00100000:1.0F:1736271490.424235:0:10332:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058961600 00000100:00100000:3.0:1736271490.424257:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:3.0:1736271490.424280:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058961472:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271490.424282:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 605 00000100:00100000:1.0:1736271490.424283:0:10332:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6940 00000100:00100000:0.0:1736271490.424285:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058961536:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000020:02000000:3.0:1736271490.424285:0:18267:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1736271490.424287:0:10332:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ec740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058961600:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000020:02000000:0.0:1736271490.424289:0:27148:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:1.0:1736271490.424290:0:10332:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736271490.424315:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058961536:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 30us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271490.424315:0:10332:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ec740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058961600:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 28us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271490.424320:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 605 00000100:00100000:1.0:1736271490.424320:0:10332:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6940 00000100:00100000:3.0:1736271490.424324:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058961472:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 44us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271490.424330:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 158 00000400:00080000:0.0:1736271490.434928:0:18917:0:(debug.c:393:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1736271490.18293 00010000:02000000:2.0:1736271490.434943:0:18293:0:(ldlm_lib.c:1759:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:02, of 2 clients 1 recovered and 1 was evicted. 00000004:00080000:0.0:1736271490.447214:0:18280:0:(osp_precreate.c:874:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x484a:0x0] 00000004:00080000:1.0:1736271490.447245:0:18282:0:(osp_precreate.c:874:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x43d0:0x0] 00000100:00100000:0.0:1736271490.447251:0:18280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7d2d0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18280:1820604024048640:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1736271490.447277:0:18282:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b78da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18282:1820604024048704:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1736271490.447321:0:18282:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271490.447338:0:18282:0:(client.c:2492:ptlrpc_set_wait()) set ffff88006eb9ae40 going to sleep for 20 seconds 00000100:00100000:0.0:1736271490.447354:0:18280:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271490.447355:0:10332:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024048704 00000100:00100000:0.0:1736271490.447367:0:18280:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d340f00 going to sleep for 20 seconds 00000100:00100000:3.0:1736271490.447376:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024048640 00000100:00100000:1.0:1736271490.447383:0:10332:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121019 00000100:00100000:1.0:1736271490.447388:0:10332:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7897c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:18282:x1820604024048704:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1736271490.447392:0:9275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121020 00000020:02000000:1.0:1736271490.447393:0:10332:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736271490.447395:0:9275:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b13440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:18280:x1820604024048640:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:0.0:1736271490.447399:0:9275:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1736271490.447411:0:9275:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 18537 -> diff = -31 00002000:00080000:1.0:1736271490.447411:0:10332:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 17889 -> diff = -529 00002000:02000040:0.0:1736271490.447413:0:9275:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0000: deleting orphan objects from 0x0:18507 to 0x0:18537 00002000:02000040:1.0:1736271490.447413:0:10332:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0001: deleting orphan objects from 0x0:17361 to 0x0:17889 00002000:00010000:1.0:1736271490.447441:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.447445:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97f180/0xed4dbb87898d4540 lrc: 3/0,1 mode: --/PW res: [0x45e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447453:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.447454:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.447458:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97f180/0xed4dbb87898d4540 lrc: 3/0,1 mode: PW/PW res: [0x45e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447467:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97f180/0xed4dbb87898d4540 lrc: 3/0,1 mode: PW/PW res: [0x45e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447480:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97f180/0xed4dbb87898d4540 lrc: 3/0,1 mode: PW/PW res: [0x45e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447483:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97f180/0xed4dbb87898d4540 lrc: 2/0,0 mode: PW/PW res: [0x45e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447499:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.447522:0:9291:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.447527:0:9291:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97f180/0xed4dbb87898d4540 lrc: 2/0,0 mode: PW/PW res: [0x45e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447535:0:9291:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97f180 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.447538:0:9291:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97f180/0xed4dbb87898d4540 lrc: 2/0,0 mode: PW/PW res: [0x45e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447545:0:9291:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97f180/0xed4dbb87898d4540 lrc: 3/0,0 mode: PW/PW res: [0x45e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447560:0:9291:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97f180/0xed4dbb87898d4540 lrc: 1/0,0 mode: --/PW res: [0x45e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447566:0:9291:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97f180/0xed4dbb87898d4540 lrc: 0/0,0 mode: --/PW res: [0x45e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447587:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.447589:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.447590:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1736271490.447599:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.447601:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97df80/0xed4dbb87898d4547 lrc: 3/0,1 mode: --/PW res: [0x45e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447605:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.447605:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.447606:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97df80/0xed4dbb87898d4547 lrc: 3/0,1 mode: PW/PW res: [0x45e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447611:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97df80/0xed4dbb87898d4547 lrc: 3/0,1 mode: PW/PW res: [0x45e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447614:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97df80/0xed4dbb87898d4547 lrc: 3/0,1 mode: PW/PW res: [0x45e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447617:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97df80/0xed4dbb87898d4547 lrc: 2/0,0 mode: PW/PW res: [0x45e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447623:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.447631:0:24474:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.447639:0:24474:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97df80/0xed4dbb87898d4547 lrc: 2/0,0 mode: PW/PW res: [0x45e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447644:0:24474:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97df80 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.447646:0:24474:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97df80/0xed4dbb87898d4547 lrc: 2/0,0 mode: PW/PW res: [0x45e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.447651:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1736271490.447651:0:24474:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97df80/0xed4dbb87898d4547 lrc: 3/0,0 mode: PW/PW res: [0x45e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447656:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97eac0/0xed4dbb87898d454e lrc: 3/0,1 mode: --/PW res: [0x45df:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447658:0:24474:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97df80/0xed4dbb87898d4547 lrc: 1/0,0 mode: --/PW res: [0x45e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447660:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.447661:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.447662:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97eac0/0xed4dbb87898d454e lrc: 3/0,1 mode: PW/PW res: [0x45df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447663:0:24474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97df80/0xed4dbb87898d4547 lrc: 0/0,0 mode: --/PW res: [0x45e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447666:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97eac0/0xed4dbb87898d454e lrc: 3/0,1 mode: PW/PW res: [0x45df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447669:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97eac0/0xed4dbb87898d454e lrc: 3/0,1 mode: PW/PW res: [0x45df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447672:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97eac0/0xed4dbb87898d454e lrc: 2/0,0 mode: PW/PW res: [0x45df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447672:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.447673:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.447674:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.447679:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.447690:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.447692:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97eac0/0xed4dbb87898d454e lrc: 2/0,0 mode: PW/PW res: [0x45df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447696:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97eac0 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.447697:0:6841:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97eac0/0xed4dbb87898d454e lrc: 2/0,0 mode: PW/PW res: [0x45df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447701:0:6841:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97eac0/0xed4dbb87898d454e lrc: 3/0,0 mode: PW/PW res: [0x45df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447713:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97eac0/0xed4dbb87898d454e lrc: 1/0,0 mode: --/PW res: [0x45df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.447715:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.447717:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97d200/0xed4dbb87898d4555 lrc: 3/0,1 mode: --/PW res: [0x45de:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447717:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97eac0/0xed4dbb87898d454e lrc: 0/0,0 mode: --/PW res: [0x45df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447723:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1736271490.447723:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.447723:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.447724:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1736271490.447724:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.447725:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97d200/0xed4dbb87898d4555 lrc: 3/0,1 mode: PW/PW res: [0x45de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447731:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97d200/0xed4dbb87898d4555 lrc: 3/0,1 mode: PW/PW res: [0x45de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447745:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97d200/0xed4dbb87898d4555 lrc: 3/0,1 mode: PW/PW res: [0x45de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447750:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97d200/0xed4dbb87898d4555 lrc: 2/0,0 mode: PW/PW res: [0x45de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447760:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.447766:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.447767:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97d200/0xed4dbb87898d4555 lrc: 2/0,0 mode: PW/PW res: [0x45de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447771:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97d200 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.447772:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97d200/0xed4dbb87898d4555 lrc: 2/0,0 mode: PW/PW res: [0x45de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447775:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97d200/0xed4dbb87898d4555 lrc: 3/0,0 mode: PW/PW res: [0x45de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447779:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97d200/0xed4dbb87898d4555 lrc: 1/0,0 mode: --/PW res: [0x45de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447781:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97d200/0xed4dbb87898d4555 lrc: 0/0,0 mode: --/PW res: [0x45de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.447787:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.447790:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.447791:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1736271490.447827:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.447831:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97db00/0xed4dbb87898d455c lrc: 3/0,1 mode: --/PW res: [0x45dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447838:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.447839:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.447840:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97db00/0xed4dbb87898d455c lrc: 3/0,1 mode: PW/PW res: [0x45dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447847:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97db00/0xed4dbb87898d455c lrc: 3/0,1 mode: PW/PW res: [0x45dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447853:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97db00/0xed4dbb87898d455c lrc: 3/0,1 mode: PW/PW res: [0x45dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447857:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97db00/0xed4dbb87898d455c lrc: 2/0,0 mode: PW/PW res: [0x45dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447867:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.447874:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.447878:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97db00/0xed4dbb87898d455c lrc: 2/0,0 mode: PW/PW res: [0x45dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.447883:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97db00 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.447884:0:9292:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97db00/0xed4dbb87898d455c lrc: 2/0,0 mode: PW/PW res: [0x45dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.447888:0:9292:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97db00/0xed4dbb87898d455c lrc: 3/0,0 mode: PW/PW res: [0x45dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.447896:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97db00/0xed4dbb87898d455c lrc: 1/0,0 mode: --/PW res: [0x45dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.447899:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97db00/0xed4dbb87898d455c lrc: 0/0,0 mode: --/PW res: [0x45dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.447907:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.447907:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.447908:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1736271490.447919:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.447928:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97d440/0xed4dbb87898d4563 lrc: 3/0,1 mode: --/PW res: [0x45dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447933:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.447934:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.447936:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97d440/0xed4dbb87898d4563 lrc: 3/0,1 mode: PW/PW res: [0x45dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447942:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97d440/0xed4dbb87898d4563 lrc: 3/0,1 mode: PW/PW res: [0x45dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447948:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97d440/0xed4dbb87898d4563 lrc: 3/0,1 mode: PW/PW res: [0x45dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447952:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97d440/0xed4dbb87898d4563 lrc: 2/0,0 mode: PW/PW res: [0x45dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.447970:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.447998:0:9291:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.448001:0:9291:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97d440/0xed4dbb87898d4563 lrc: 2/0,0 mode: PW/PW res: [0x45dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448008:0:9291:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97d440 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.448009:0:9291:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97d440/0xed4dbb87898d4563 lrc: 2/0,0 mode: PW/PW res: [0x45dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448013:0:9291:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97d440/0xed4dbb87898d4563 lrc: 3/0,0 mode: PW/PW res: [0x45dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448020:0:9291:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97d440/0xed4dbb87898d4563 lrc: 1/0,0 mode: --/PW res: [0x45dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.448024:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1736271490.448024:0:9291:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97d440/0xed4dbb87898d4563 lrc: 0/0,0 mode: --/PW res: [0x45dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448027:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97ed00/0xed4dbb87898d456a lrc: 3/0,1 mode: --/PW res: [0x45db:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448033:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1736271490.448033:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448034:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1736271490.448034:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448034:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448035:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97ed00/0xed4dbb87898d456a lrc: 3/0,1 mode: PW/PW res: [0x45db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448041:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97ed00/0xed4dbb87898d456a lrc: 3/0,1 mode: PW/PW res: [0x45db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448055:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97ed00/0xed4dbb87898d456a lrc: 3/0,1 mode: PW/PW res: [0x45db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448061:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97ed00/0xed4dbb87898d456a lrc: 2/0,0 mode: PW/PW res: [0x45db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448071:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.448079:0:24474:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.448082:0:24474:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97ed00/0xed4dbb87898d456a lrc: 2/0,0 mode: PW/PW res: [0x45db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448088:0:24474:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97ed00 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.448089:0:24474:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97ed00/0xed4dbb87898d456a lrc: 2/0,0 mode: PW/PW res: [0x45db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448105:0:24474:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97ed00/0xed4dbb87898d456a lrc: 3/0,0 mode: PW/PW res: [0x45db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448114:0:24474:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97ed00/0xed4dbb87898d456a lrc: 1/0,0 mode: --/PW res: [0x45db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.448118:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.448120:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97cfc0/0xed4dbb87898d4571 lrc: 3/0,1 mode: --/PW res: [0x45da:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448120:0:24474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97ed00/0xed4dbb87898d456a lrc: 0/0,0 mode: --/PW res: [0x45db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448125:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448125:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448126:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97cfc0/0xed4dbb87898d4571 lrc: 3/0,1 mode: PW/PW res: [0x45da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448129:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448130:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97cfc0/0xed4dbb87898d4571 lrc: 3/0,1 mode: PW/PW res: [0x45da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448130:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448131:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448134:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97cfc0/0xed4dbb87898d4571 lrc: 3/0,1 mode: PW/PW res: [0x45da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448136:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97cfc0/0xed4dbb87898d4571 lrc: 2/0,0 mode: PW/PW res: [0x45da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448149:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.448151:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.448153:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97cfc0/0xed4dbb87898d4571 lrc: 2/0,0 mode: PW/PW res: [0x45da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448159:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97cfc0 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.448160:0:6841:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97cfc0/0xed4dbb87898d4571 lrc: 2/0,0 mode: PW/PW res: [0x45da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448165:0:6841:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97cfc0/0xed4dbb87898d4571 lrc: 3/0,0 mode: PW/PW res: [0x45da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448173:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97cfc0/0xed4dbb87898d4571 lrc: 1/0,0 mode: --/PW res: [0x45da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448178:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97cfc0/0xed4dbb87898d4571 lrc: 0/0,0 mode: --/PW res: [0x45da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.448182:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.448187:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97ef40/0xed4dbb87898d4578 lrc: 3/0,1 mode: --/PW res: [0x45d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448191:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448192:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448193:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97ef40/0xed4dbb87898d4578 lrc: 3/0,1 mode: PW/PW res: [0x45d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448194:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448195:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448196:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448197:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97ef40/0xed4dbb87898d4578 lrc: 3/0,1 mode: PW/PW res: [0x45d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448200:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97ef40/0xed4dbb87898d4578 lrc: 3/0,1 mode: PW/PW res: [0x45d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448203:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97ef40/0xed4dbb87898d4578 lrc: 2/0,0 mode: PW/PW res: [0x45d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448208:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.448215:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.448217:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97ef40/0xed4dbb87898d4578 lrc: 2/0,0 mode: PW/PW res: [0x45d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448222:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97ef40 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.448223:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97ef40/0xed4dbb87898d4578 lrc: 2/0,0 mode: PW/PW res: [0x45d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448229:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97ef40/0xed4dbb87898d4578 lrc: 3/0,0 mode: PW/PW res: [0x45d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448237:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97ef40/0xed4dbb87898d4578 lrc: 1/0,0 mode: --/PW res: [0x45d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.448241:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.448242:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97fa80/0xed4dbb87898d457f lrc: 3/0,1 mode: --/PW res: [0x45d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448242:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97ef40/0xed4dbb87898d4578 lrc: 0/0,0 mode: --/PW res: [0x45d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448246:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448246:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448247:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97fa80/0xed4dbb87898d457f lrc: 3/0,1 mode: PW/PW res: [0x45d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448250:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97fa80/0xed4dbb87898d457f lrc: 3/0,1 mode: PW/PW res: [0x45d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448251:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448252:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448253:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448275:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97fa80/0xed4dbb87898d457f lrc: 3/0,1 mode: PW/PW res: [0x45d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448279:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97fa80/0xed4dbb87898d457f lrc: 2/0,0 mode: PW/PW res: [0x45d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448289:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.448309:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.448311:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97fa80/0xed4dbb87898d457f lrc: 2/0,0 mode: PW/PW res: [0x45d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.448315:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97fa80 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.448321:0:9292:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97fa80/0xed4dbb87898d457f lrc: 2/0,0 mode: PW/PW res: [0x45d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.448325:0:9292:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97fa80/0xed4dbb87898d457f lrc: 3/0,0 mode: PW/PW res: [0x45d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.448327:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.448329:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97c480/0xed4dbb87898d4586 lrc: 3/0,1 mode: --/PW res: [0x45d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448332:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736271490.448332:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97fa80/0xed4dbb87898d457f lrc: 1/0,0 mode: --/PW res: [0x45d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448333:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448334:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97c480/0xed4dbb87898d4586 lrc: 3/0,1 mode: PW/PW res: [0x45d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.448335:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97fa80/0xed4dbb87898d457f lrc: 0/0,0 mode: --/PW res: [0x45d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448338:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97c480/0xed4dbb87898d4586 lrc: 3/0,1 mode: PW/PW res: [0x45d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448341:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97c480/0xed4dbb87898d4586 lrc: 3/0,1 mode: PW/PW res: [0x45d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.448343:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.448344:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.448345:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448348:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97c480/0xed4dbb87898d4586 lrc: 2/0,0 mode: PW/PW res: [0x45d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448354:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.448363:0:9291:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.448365:0:9291:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97c480/0xed4dbb87898d4586 lrc: 2/0,0 mode: PW/PW res: [0x45d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448371:0:9291:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97c480 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.448377:0:9291:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97c480/0xed4dbb87898d4586 lrc: 2/0,0 mode: PW/PW res: [0x45d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448383:0:9291:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97c480/0xed4dbb87898d4586 lrc: 3/0,0 mode: PW/PW res: [0x45d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.448384:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.448391:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97d8c0/0xed4dbb87898d458d lrc: 3/0,1 mode: --/PW res: [0x45d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448392:0:9291:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97c480/0xed4dbb87898d4586 lrc: 1/0,0 mode: --/PW res: [0x45d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448397:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1736271490.448397:0:9291:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97c480/0xed4dbb87898d4586 lrc: 0/0,0 mode: --/PW res: [0x45d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448398:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448399:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97d8c0/0xed4dbb87898d458d lrc: 3/0,1 mode: PW/PW res: [0x45d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448406:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97d8c0/0xed4dbb87898d458d lrc: 3/0,1 mode: PW/PW res: [0x45d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448409:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448410:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448411:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97d8c0/0xed4dbb87898d458d lrc: 3/0,1 mode: PW/PW res: [0x45d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448411:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448416:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97d8c0/0xed4dbb87898d458d lrc: 2/0,0 mode: PW/PW res: [0x45d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448426:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.448433:0:24474:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.448435:0:24474:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97d8c0/0xed4dbb87898d458d lrc: 2/0,0 mode: PW/PW res: [0x45d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448440:0:24474:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97d8c0 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.448442:0:24474:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97d8c0/0xed4dbb87898d458d lrc: 2/0,0 mode: PW/PW res: [0x45d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448447:0:24474:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97d8c0/0xed4dbb87898d458d lrc: 3/0,0 mode: PW/PW res: [0x45d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448455:0:24474:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97d8c0/0xed4dbb87898d458d lrc: 1/0,0 mode: --/PW res: [0x45d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448469:0:24474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97d8c0/0xed4dbb87898d458d lrc: 0/0,0 mode: --/PW res: [0x45d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448480:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1736271490.448481:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1736271490.448481:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448483:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448485:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97e640/0xed4dbb87898d4594 lrc: 3/0,1 mode: --/PW res: [0x45d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448491:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448491:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448493:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97e640/0xed4dbb87898d4594 lrc: 3/0,1 mode: PW/PW res: [0x45d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448500:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97e640/0xed4dbb87898d4594 lrc: 3/0,1 mode: PW/PW res: [0x45d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448514:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97e640/0xed4dbb87898d4594 lrc: 3/0,1 mode: PW/PW res: [0x45d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448519:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97e640/0xed4dbb87898d4594 lrc: 2/0,0 mode: PW/PW res: [0x45d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448529:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.448537:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.448539:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97e640/0xed4dbb87898d4594 lrc: 2/0,0 mode: PW/PW res: [0x45d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448545:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97e640 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.448546:0:6841:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97e640/0xed4dbb87898d4594 lrc: 2/0,0 mode: PW/PW res: [0x45d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448552:0:6841:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97e640/0xed4dbb87898d4594 lrc: 3/0,0 mode: PW/PW res: [0x45d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448560:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97e640/0xed4dbb87898d4594 lrc: 1/0,0 mode: --/PW res: [0x45d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448564:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97e640/0xed4dbb87898d4594 lrc: 0/0,0 mode: --/PW res: [0x45d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.448572:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1736271490.448573:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448574:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97dd40/0xed4dbb87898d459b lrc: 3/0,1 mode: --/PW res: [0x45d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448574:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448575:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448578:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448579:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448580:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97dd40/0xed4dbb87898d459b lrc: 3/0,1 mode: PW/PW res: [0x45d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448584:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97dd40/0xed4dbb87898d459b lrc: 3/0,1 mode: PW/PW res: [0x45d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448587:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97dd40/0xed4dbb87898d459b lrc: 3/0,1 mode: PW/PW res: [0x45d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448590:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97dd40/0xed4dbb87898d459b lrc: 2/0,0 mode: PW/PW res: [0x45d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448595:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.448601:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.448607:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97dd40/0xed4dbb87898d459b lrc: 2/0,0 mode: PW/PW res: [0x45d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448612:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97dd40 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.448614:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97dd40/0xed4dbb87898d459b lrc: 2/0,0 mode: PW/PW res: [0x45d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448619:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97dd40/0xed4dbb87898d459b lrc: 3/0,0 mode: PW/PW res: [0x45d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.448622:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1736271490.448625:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97dd40/0xed4dbb87898d459b lrc: 1/0,0 mode: --/PW res: [0x45d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448627:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97c900/0xed4dbb87898d45a2 lrc: 3/0,1 mode: --/PW res: [0x45d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448628:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97dd40/0xed4dbb87898d459b lrc: 0/0,0 mode: --/PW res: [0x45d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448630:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448631:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448632:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97c900/0xed4dbb87898d45a2 lrc: 3/0,1 mode: PW/PW res: [0x45d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448636:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97c900/0xed4dbb87898d45a2 lrc: 3/0,1 mode: PW/PW res: [0x45d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448636:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448636:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448637:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448639:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97c900/0xed4dbb87898d45a2 lrc: 3/0,1 mode: PW/PW res: [0x45d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448642:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97c900/0xed4dbb87898d45a2 lrc: 2/0,0 mode: PW/PW res: [0x45d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448654:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.448682:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.448685:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97c900/0xed4dbb87898d45a2 lrc: 2/0,0 mode: PW/PW res: [0x45d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.448689:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.448690:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97f840/0xed4dbb87898d45a9 lrc: 3/0,1 mode: --/PW res: [0x45d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.448692:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97c900 already unused, calling callback (ffffffffa076c190) 00010000:00010000:1.0:1736271490.448694:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448694:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736271490.448694:0:9292:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97c900/0xed4dbb87898d45a2 lrc: 2/0,0 mode: PW/PW res: [0x45d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448695:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97f840/0xed4dbb87898d45a9 lrc: 3/0,1 mode: PW/PW res: [0x45d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448698:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97f840/0xed4dbb87898d45a9 lrc: 3/0,1 mode: PW/PW res: [0x45d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.448700:0:9292:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97c900/0xed4dbb87898d45a2 lrc: 3/0,0 mode: PW/PW res: [0x45d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448708:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97f840/0xed4dbb87898d45a9 lrc: 3/0,1 mode: PW/PW res: [0x45d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.448709:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97c900/0xed4dbb87898d45a2 lrc: 1/0,0 mode: --/PW res: [0x45d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448713:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97f840/0xed4dbb87898d45a9 lrc: 2/0,0 mode: PW/PW res: [0x45d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448721:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.448724:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97c900/0xed4dbb87898d45a2 lrc: 0/0,0 mode: --/PW res: [0x45d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448726:0:9291:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.448727:0:9291:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97f840/0xed4dbb87898d45a9 lrc: 2/0,0 mode: PW/PW res: [0x45d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448730:0:9291:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97f840 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.448731:0:9291:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97f840/0xed4dbb87898d45a9 lrc: 2/0,0 mode: PW/PW res: [0x45d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448734:0:9291:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97f840/0xed4dbb87898d45a9 lrc: 3/0,0 mode: PW/PW res: [0x45d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.448737:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.448738:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.448739:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448746:0:9291:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97f840/0xed4dbb87898d45a9 lrc: 1/0,0 mode: --/PW res: [0x45d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448749:0:9291:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97f840/0xed4dbb87898d45a9 lrc: 0/0,0 mode: --/PW res: [0x45d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448756:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448757:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448758:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1736271490.448773:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.448776:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97e400/0xed4dbb87898d45b0 lrc: 3/0,1 mode: --/PW res: [0x45d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448783:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448784:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448785:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97e400/0xed4dbb87898d45b0 lrc: 3/0,1 mode: PW/PW res: [0x45d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448792:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97e400/0xed4dbb87898d45b0 lrc: 3/0,1 mode: PW/PW res: [0x45d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448797:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97e400/0xed4dbb87898d45b0 lrc: 3/0,1 mode: PW/PW res: [0x45d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448801:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97e400/0xed4dbb87898d45b0 lrc: 2/0,0 mode: PW/PW res: [0x45d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448809:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.448833:0:24474:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.448836:0:24474:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97e400/0xed4dbb87898d45b0 lrc: 2/0,0 mode: PW/PW res: [0x45d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448841:0:24474:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97e400 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.448842:0:24474:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97e400/0xed4dbb87898d45b0 lrc: 2/0,0 mode: PW/PW res: [0x45d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448846:0:24474:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97e400/0xed4dbb87898d45b0 lrc: 3/0,0 mode: PW/PW res: [0x45d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448852:0:24474:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97e400/0xed4dbb87898d45b0 lrc: 1/0,0 mode: --/PW res: [0x45d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448854:0:24474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97e400/0xed4dbb87898d45b0 lrc: 0/0,0 mode: --/PW res: [0x45d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448861:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448865:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1736271490.448866:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1736271490.448866:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448872:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97c240/0xed4dbb87898d45b7 lrc: 3/0,1 mode: --/PW res: [0x45d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448877:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448877:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448878:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97c240/0xed4dbb87898d45b7 lrc: 3/0,1 mode: PW/PW res: [0x45d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448883:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97c240/0xed4dbb87898d45b7 lrc: 3/0,1 mode: PW/PW res: [0x45d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448887:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97c240/0xed4dbb87898d45b7 lrc: 3/0,1 mode: PW/PW res: [0x45d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448890:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97c240/0xed4dbb87898d45b7 lrc: 2/0,0 mode: PW/PW res: [0x45d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448896:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.448901:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.448902:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97c240/0xed4dbb87898d45b7 lrc: 2/0,0 mode: PW/PW res: [0x45d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448906:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97c240 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.448907:0:6841:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97c240/0xed4dbb87898d45b7 lrc: 2/0,0 mode: PW/PW res: [0x45d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448910:0:6841:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97c240/0xed4dbb87898d45b7 lrc: 3/0,0 mode: PW/PW res: [0x45d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448914:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97c240/0xed4dbb87898d45b7 lrc: 1/0,0 mode: --/PW res: [0x45d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448917:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97c240/0xed4dbb87898d45b7 lrc: 0/0,0 mode: --/PW res: [0x45d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448923:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448924:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448925:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1736271490.448931:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.448933:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97c000/0xed4dbb87898d45be lrc: 3/0,1 mode: --/PW res: [0x45cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448936:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448937:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448938:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97c000/0xed4dbb87898d45be lrc: 3/0,1 mode: PW/PW res: [0x45cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448942:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97c000/0xed4dbb87898d45be lrc: 3/0,1 mode: PW/PW res: [0x45cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448950:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97c000/0xed4dbb87898d45be lrc: 3/0,1 mode: PW/PW res: [0x45cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448953:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97c000/0xed4dbb87898d45be lrc: 2/0,0 mode: PW/PW res: [0x45cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448958:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.448963:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.448964:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97c000/0xed4dbb87898d45be lrc: 2/0,0 mode: PW/PW res: [0x45cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448967:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97c000 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.448968:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97c000/0xed4dbb87898d45be lrc: 2/0,0 mode: PW/PW res: [0x45cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448977:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97c000/0xed4dbb87898d45be lrc: 3/0,0 mode: PW/PW res: [0x45cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448982:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97c000/0xed4dbb87898d45be lrc: 1/0,0 mode: --/PW res: [0x45cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448984:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97c000/0xed4dbb87898d45be lrc: 0/0,0 mode: --/PW res: [0x45cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.448989:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.448990:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97d680/0xed4dbb87898d45c5 lrc: 3/0,1 mode: --/PW res: [0x45ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.448990:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448991:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.448991:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.448993:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448994:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.448995:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97d680/0xed4dbb87898d45c5 lrc: 3/0,1 mode: PW/PW res: [0x45ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.448998:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97d680/0xed4dbb87898d45c5 lrc: 3/0,1 mode: PW/PW res: [0x45ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449001:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97d680/0xed4dbb87898d45c5 lrc: 3/0,1 mode: PW/PW res: [0x45ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449004:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97d680/0xed4dbb87898d45c5 lrc: 2/0,0 mode: PW/PW res: [0x45ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449016:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.449034:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.449037:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97d680/0xed4dbb87898d45c5 lrc: 2/0,0 mode: PW/PW res: [0x45ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449042:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97d680 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.449043:0:9292:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97d680/0xed4dbb87898d45c5 lrc: 2/0,0 mode: PW/PW res: [0x45ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.449046:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736271490.449046:0:9292:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97d680/0xed4dbb87898d45c5 lrc: 3/0,0 mode: PW/PW res: [0x45ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449051:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97f3c0/0xed4dbb87898d45cc lrc: 3/0,1 mode: --/PW res: [0x45cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449053:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97d680/0xed4dbb87898d45c5 lrc: 1/0,0 mode: --/PW res: [0x45ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449054:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449055:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449056:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97f3c0/0xed4dbb87898d45cc lrc: 3/0,1 mode: PW/PW res: [0x45cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449057:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97d680/0xed4dbb87898d45c5 lrc: 0/0,0 mode: --/PW res: [0x45ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449060:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97f3c0/0xed4dbb87898d45cc lrc: 3/0,1 mode: PW/PW res: [0x45cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449063:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97f3c0/0xed4dbb87898d45cc lrc: 3/0,1 mode: PW/PW res: [0x45cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449066:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97f3c0/0xed4dbb87898d45cc lrc: 2/0,0 mode: PW/PW res: [0x45cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449069:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.449070:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.449071:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.449072:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.449074:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97f3c0/0xed4dbb87898d45cc lrc: 2/0,0 mode: PW/PW res: [0x45cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449081:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.449083:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97f3c0 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.449085:0:9292:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97f3c0/0xed4dbb87898d45cc lrc: 2/0,0 mode: PW/PW res: [0x45cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449091:0:9292:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97f3c0/0xed4dbb87898d45cc lrc: 3/0,0 mode: PW/PW res: [0x45cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449100:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97f3c0/0xed4dbb87898d45cc lrc: 1/0,0 mode: --/PW res: [0x45cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.449102:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.449104:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97c6c0/0xed4dbb87898d45d3 lrc: 3/0,1 mode: --/PW res: [0x45cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449105:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97f3c0/0xed4dbb87898d45cc lrc: 0/0,0 mode: --/PW res: [0x45cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449107:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449108:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449108:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97c6c0/0xed4dbb87898d45d3 lrc: 3/0,1 mode: PW/PW res: [0x45cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449112:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97c6c0/0xed4dbb87898d45d3 lrc: 3/0,1 mode: PW/PW res: [0x45cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449115:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.449116:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.449118:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.449120:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97c6c0/0xed4dbb87898d45d3 lrc: 3/0,1 mode: PW/PW res: [0x45cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449123:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97c6c0/0xed4dbb87898d45d3 lrc: 2/0,0 mode: PW/PW res: [0x45cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449128:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.449135:0:24474:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.449137:0:24474:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97c6c0/0xed4dbb87898d45d3 lrc: 2/0,0 mode: PW/PW res: [0x45cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449142:0:24474:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97c6c0 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.449143:0:24474:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97c6c0/0xed4dbb87898d45d3 lrc: 2/0,0 mode: PW/PW res: [0x45cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449148:0:24474:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97c6c0/0xed4dbb87898d45d3 lrc: 3/0,0 mode: PW/PW res: [0x45cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449156:0:24474:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97c6c0/0xed4dbb87898d45d3 lrc: 1/0,0 mode: --/PW res: [0x45cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.449159:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.449160:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97cb40/0xed4dbb87898d45da lrc: 3/0,1 mode: --/PW res: [0x45cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449164:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449165:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449166:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97cb40/0xed4dbb87898d45da lrc: 3/0,1 mode: PW/PW res: [0x45cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449169:0:24474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97c6c0/0xed4dbb87898d45d3 lrc: 0/0,0 mode: --/PW res: [0x45cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449173:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97cb40/0xed4dbb87898d45da lrc: 3/0,1 mode: PW/PW res: [0x45cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449178:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97cb40/0xed4dbb87898d45da lrc: 3/0,1 mode: PW/PW res: [0x45cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449178:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449178:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449179:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.449183:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97cb40/0xed4dbb87898d45da lrc: 2/0,0 mode: PW/PW res: [0x45cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449192:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.449197:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.449198:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97cb40/0xed4dbb87898d45da lrc: 2/0,0 mode: PW/PW res: [0x45cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449203:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97cb40 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.449205:0:6841:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97cb40/0xed4dbb87898d45da lrc: 2/0,0 mode: PW/PW res: [0x45cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449209:0:6841:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97cb40/0xed4dbb87898d45da lrc: 3/0,0 mode: PW/PW res: [0x45cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449215:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97cb40/0xed4dbb87898d45da lrc: 1/0,0 mode: --/PW res: [0x45cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449219:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97cb40/0xed4dbb87898d45da lrc: 0/0,0 mode: --/PW res: [0x45cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449227:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449228:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449229:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1736271490.449238:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.449244:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97cd80/0xed4dbb87898d45e1 lrc: 3/0,1 mode: --/PW res: [0x45ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449251:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449252:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449253:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97cd80/0xed4dbb87898d45e1 lrc: 3/0,1 mode: PW/PW res: [0x45ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449275:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c97cd80/0xed4dbb87898d45e1 lrc: 3/0,1 mode: PW/PW res: [0x45ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449279:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c97cd80/0xed4dbb87898d45e1 lrc: 3/0,1 mode: PW/PW res: [0x45ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449282:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c97cd80/0xed4dbb87898d45e1 lrc: 2/0,0 mode: PW/PW res: [0x45ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449288:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.449294:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.449299:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c97cd80/0xed4dbb87898d45e1 lrc: 2/0,0 mode: PW/PW res: [0x45ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449304:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c97cd80 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.449306:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97cd80/0xed4dbb87898d45e1 lrc: 2/0,0 mode: PW/PW res: [0x45ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449311:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c97cd80/0xed4dbb87898d45e1 lrc: 3/0,0 mode: PW/PW res: [0x45ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449319:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c97cd80/0xed4dbb87898d45e1 lrc: 1/0,0 mode: --/PW res: [0x45ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449323:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c97cd80/0xed4dbb87898d45e1 lrc: 0/0,0 mode: --/PW res: [0x45ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.449326:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.449328:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a41f80/0xed4dbb87898d45e8 lrc: 3/0,1 mode: --/PW res: [0x45c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449331:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449332:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449333:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a41f80/0xed4dbb87898d45e8 lrc: 3/0,1 mode: PW/PW res: [0x45c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449333:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449334:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449335:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.449337:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a41f80/0xed4dbb87898d45e8 lrc: 3/0,1 mode: PW/PW res: [0x45c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449346:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a41f80/0xed4dbb87898d45e8 lrc: 3/0,1 mode: PW/PW res: [0x45c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449349:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099a41f80/0xed4dbb87898d45e8 lrc: 2/0,0 mode: PW/PW res: [0x45c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449354:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.449356:0:9291:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.449357:0:9291:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099a41f80/0xed4dbb87898d45e8 lrc: 2/0,0 mode: PW/PW res: [0x45c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449361:0:9291:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099a41f80 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.449362:0:9291:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a41f80/0xed4dbb87898d45e8 lrc: 2/0,0 mode: PW/PW res: [0x45c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449365:0:9291:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a41f80/0xed4dbb87898d45e8 lrc: 3/0,0 mode: PW/PW res: [0x45c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449375:0:9291:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099a41f80/0xed4dbb87898d45e8 lrc: 1/0,0 mode: --/PW res: [0x45c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449379:0:9291:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a41f80/0xed4dbb87898d45e8 lrc: 0/0,0 mode: --/PW res: [0x45c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449385:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449385:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449386:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1736271490.449402:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.449405:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a40b40/0xed4dbb87898d45ef lrc: 3/0,1 mode: --/PW res: [0x45c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449411:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449411:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449413:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a40b40/0xed4dbb87898d45ef lrc: 3/0,1 mode: PW/PW res: [0x45c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449419:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a40b40/0xed4dbb87898d45ef lrc: 3/0,1 mode: PW/PW res: [0x45c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449425:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a40b40/0xed4dbb87898d45ef lrc: 3/0,1 mode: PW/PW res: [0x45c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449430:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099a40b40/0xed4dbb87898d45ef lrc: 2/0,0 mode: PW/PW res: [0x45c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449446:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.449465:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.449468:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099a40b40/0xed4dbb87898d45ef lrc: 2/0,0 mode: PW/PW res: [0x45c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449474:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099a40b40 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.449476:0:9292:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a40b40/0xed4dbb87898d45ef lrc: 2/0,0 mode: PW/PW res: [0x45c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449481:0:9292:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a40b40/0xed4dbb87898d45ef lrc: 3/0,0 mode: PW/PW res: [0x45c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.449484:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.449490:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a43a80/0xed4dbb87898d45f6 lrc: 3/0,1 mode: --/PW res: [0x45c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449494:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449495:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449496:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a43a80/0xed4dbb87898d45f6 lrc: 3/0,1 mode: PW/PW res: [0x45c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449498:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099a40b40/0xed4dbb87898d45ef lrc: 1/0,0 mode: --/PW res: [0x45c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449500:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a43a80/0xed4dbb87898d45f6 lrc: 3/0,1 mode: PW/PW res: [0x45c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449502:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a40b40/0xed4dbb87898d45ef lrc: 0/0,0 mode: --/PW res: [0x45c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449503:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a43a80/0xed4dbb87898d45f6 lrc: 3/0,1 mode: PW/PW res: [0x45c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449506:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099a43a80/0xed4dbb87898d45f6 lrc: 2/0,0 mode: PW/PW res: [0x45c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449512:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.449513:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.449514:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099a43a80/0xed4dbb87898d45f6 lrc: 3/0,0 mode: PW/PW res: [0x45c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449518:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099a43a80 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.449520:0:9292:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a43a80/0xed4dbb87898d45f6 lrc: 3/0,0 mode: PW/PW res: [0x45c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449521:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1736271490.449524:0:9292:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a43a80/0xed4dbb87898d45f6 lrc: 3/0,0 mode: PW/PW res: [0x45c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449529:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099a43a80/0xed4dbb87898d45f6 lrc: 1/0,0 mode: --/PW res: [0x45c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.449533:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a43a80/0xed4dbb87898d45f6 lrc: 0/0,0 mode: --/PW res: [0x45c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449535:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.449541:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.449541:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.449542:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1736271490.449569:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.449572:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a421c0/0xed4dbb87898d45fd lrc: 3/0,1 mode: --/PW res: [0x45c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449579:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449580:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449582:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a421c0/0xed4dbb87898d45fd lrc: 3/0,1 mode: PW/PW res: [0x45c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449589:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a421c0/0xed4dbb87898d45fd lrc: 3/0,1 mode: PW/PW res: [0x45c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449603:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a421c0/0xed4dbb87898d45fd lrc: 3/0,1 mode: PW/PW res: [0x45c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449608:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099a421c0/0xed4dbb87898d45fd lrc: 2/0,0 mode: PW/PW res: [0x45c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449617:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.449621:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.449624:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099a421c0/0xed4dbb87898d45fd lrc: 2/0,0 mode: PW/PW res: [0x45c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449629:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099a421c0 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.449631:0:6841:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a421c0/0xed4dbb87898d45fd lrc: 2/0,0 mode: PW/PW res: [0x45c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449636:0:6841:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a421c0/0xed4dbb87898d45fd lrc: 3/0,0 mode: PW/PW res: [0x45c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449645:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099a421c0/0xed4dbb87898d45fd lrc: 1/0,0 mode: --/PW res: [0x45c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449650:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a421c0/0xed4dbb87898d45fd lrc: 0/0,0 mode: --/PW res: [0x45c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1736271490.449665:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.449668:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a40240/0xed4dbb87898d4604 lrc: 3/0,1 mode: --/PW res: [0x45c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449669:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449670:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449671:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271490.449673:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449674:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449676:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a40240/0xed4dbb87898d4604 lrc: 3/0,1 mode: PW/PW res: [0x45c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449682:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a40240/0xed4dbb87898d4604 lrc: 3/0,1 mode: PW/PW res: [0x45c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449687:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a40240/0xed4dbb87898d4604 lrc: 3/0,1 mode: PW/PW res: [0x45c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449691:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099a40240/0xed4dbb87898d4604 lrc: 2/0,0 mode: PW/PW res: [0x45c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449699:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.449701:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.449703:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099a40240/0xed4dbb87898d4604 lrc: 2/0,0 mode: PW/PW res: [0x45c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449708:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099a40240 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.449710:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a40240/0xed4dbb87898d4604 lrc: 2/0,0 mode: PW/PW res: [0x45c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449714:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a40240/0xed4dbb87898d4604 lrc: 3/0,0 mode: PW/PW res: [0x45c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449720:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099a40240/0xed4dbb87898d4604 lrc: 1/0,0 mode: --/PW res: [0x45c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449725:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a40240/0xed4dbb87898d4604 lrc: 0/0,0 mode: --/PW res: [0x45c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449733:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449733:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449734:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1736271490.449744:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.449752:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a40900/0xed4dbb87898d460b lrc: 3/0,1 mode: --/PW res: [0x45c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449758:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449759:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449760:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a40900/0xed4dbb87898d460b lrc: 3/0,1 mode: PW/PW res: [0x45c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449766:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a40900/0xed4dbb87898d460b lrc: 3/0,1 mode: PW/PW res: [0x45c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449771:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a40900/0xed4dbb87898d460b lrc: 3/0,1 mode: PW/PW res: [0x45c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449775:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099a40900/0xed4dbb87898d460b lrc: 2/0,0 mode: PW/PW res: [0x45c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449784:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.449789:0:9291:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.449791:0:9291:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099a40900/0xed4dbb87898d460b lrc: 2/0,0 mode: PW/PW res: [0x45c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449795:0:9291:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099a40900 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.449801:0:9291:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a40900/0xed4dbb87898d460b lrc: 2/0,0 mode: PW/PW res: [0x45c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449807:0:9291:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a40900/0xed4dbb87898d460b lrc: 3/0,0 mode: PW/PW res: [0x45c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449827:0:9291:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099a40900/0xed4dbb87898d460b lrc: 1/0,0 mode: --/PW res: [0x45c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449832:0:9291:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a40900/0xed4dbb87898d460b lrc: 0/0,0 mode: --/PW res: [0x45c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449843:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449843:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449845:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1736271490.449855:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.449858:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a42880/0xed4dbb87898d4612 lrc: 3/0,1 mode: --/PW res: [0x45c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449865:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449866:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449868:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a42880/0xed4dbb87898d4612 lrc: 3/0,1 mode: PW/PW res: [0x45c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449874:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a42880/0xed4dbb87898d4612 lrc: 3/0,1 mode: PW/PW res: [0x45c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449889:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a42880/0xed4dbb87898d4612 lrc: 3/0,1 mode: PW/PW res: [0x45c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449892:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099a42880/0xed4dbb87898d4612 lrc: 2/0,0 mode: PW/PW res: [0x45c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449899:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.449903:0:24474:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.449905:0:24474:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099a42880/0xed4dbb87898d4612 lrc: 2/0,0 mode: PW/PW res: [0x45c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449909:0:24474:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099a42880 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.449910:0:24474:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a42880/0xed4dbb87898d4612 lrc: 2/0,0 mode: PW/PW res: [0x45c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449913:0:24474:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a42880/0xed4dbb87898d4612 lrc: 3/0,0 mode: PW/PW res: [0x45c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449919:0:24474:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099a42880/0xed4dbb87898d4612 lrc: 1/0,0 mode: --/PW res: [0x45c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449928:0:24474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a42880/0xed4dbb87898d4612 lrc: 0/0,0 mode: --/PW res: [0x45c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.449935:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449935:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.449936:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1736271490.449953:0:10332:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x45c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736271490.449956:0:10332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a40000/0xed4dbb87898d4619 lrc: 3/0,1 mode: --/PW res: [0x45c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449962:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449963:0:10332:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271490.449965:0:10332:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a40000/0xed4dbb87898d4619 lrc: 3/0,1 mode: PW/PW res: [0x45c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449971:0:10332:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a40000/0xed4dbb87898d4619 lrc: 3/0,1 mode: PW/PW res: [0x45c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449977:0:10332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a40000/0xed4dbb87898d4619 lrc: 3/0,1 mode: PW/PW res: [0x45c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449982:0:10332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099a40000/0xed4dbb87898d4619 lrc: 2/0,0 mode: PW/PW res: [0x45c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271490.449997:0:10332:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.450017:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.450020:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099a40000/0xed4dbb87898d4619 lrc: 2/0,0 mode: PW/PW res: [0x45c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.450024:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099a40000 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.450025:0:9292:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a40000/0xed4dbb87898d4619 lrc: 2/0,0 mode: PW/PW res: [0x45c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.450029:0:9292:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a40000/0xed4dbb87898d4619 lrc: 3/0,0 mode: PW/PW res: [0x45c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.450035:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099a40000/0xed4dbb87898d4619 lrc: 1/0,0 mode: --/PW res: [0x45c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.450038:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a40000/0xed4dbb87898d4619 lrc: 0/0,0 mode: --/PW res: [0x45c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.450046:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.450047:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.450048:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1736271490.452321:0:10332:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x0:17360 00000100:00100000:1.0:1736271490.452378:0:10332:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7897c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:18282:x1820604024048704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4989us (5055us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271490.452386:0:10332:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121019 00000100:00100000:2.0:1736271490.452424:0:18282:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b78da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18282:1820604024048704:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1736271490.452432:0:18282:0:(osp_precreate.c:953:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x45e1:0x0] from OST, last_created [0x100010000:0x45e1:0x0]last_used is [0x100010000:0x43d0:0x0] 00000100:00100000:2.0:1736271490.452478:0:18282:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ed0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18282:1820604024048832:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1736271490.452492:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ecc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1820604024048768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1736271490.452496:0:18282:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271490.452506:0:18282:0:(client.c:2492:ptlrpc_set_wait()) set ffff880089ac8840 going to sleep for 20 seconds 00000100:00100000:1.0:1736271490.452514:0:10332:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024048832 00000100:00100000:3.0:1736271490.452515:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271490.452536:0:10332:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121021 00000100:00100000:1.0:1736271490.452540:0:10332:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ed580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:18282:x1820604024048832:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:1.0:1736271490.452544:0:10332:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:1.0:1736271490.452559:0:10332:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x0 at 17890 00000100:00100000:2.0:1736271490.452572:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024048768 00000100:00100000:2.0:1736271490.452597:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5744 00000100:00100000:2.0:1736271490.452601:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb14280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3333:x1820604024048768:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:2.0:1736271490.452611:0:11119:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1736271490.452620:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140992 pending 896 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271490.452661:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb14280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3333:x1820604024048768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271490.452666:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5744 00000100:00100000:3.0:1736271490.452730:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ecc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1820604024048768:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1736271490.453257:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4869:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.453296:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e21c0/0xed4dbb87898d4620 lrc: 3/0,1 mode: --/PW res: [0x4869:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453305:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.453306:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.453308:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e21c0/0xed4dbb87898d4620 lrc: 3/0,1 mode: PW/PW res: [0x4869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453328:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e21c0/0xed4dbb87898d4620 lrc: 3/0,1 mode: PW/PW res: [0x4869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453334:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e21c0/0xed4dbb87898d4620 lrc: 3/0,1 mode: PW/PW res: [0x4869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453339:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e21c0/0xed4dbb87898d4620 lrc: 2/0,0 mode: PW/PW res: [0x4869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453351:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.453372:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.453376:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e21c0/0xed4dbb87898d4620 lrc: 2/0,0 mode: PW/PW res: [0x4869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453383:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e21c0 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.453385:0:6841:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e21c0/0xed4dbb87898d4620 lrc: 2/0,0 mode: PW/PW res: [0x4869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453391:0:6841:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e21c0/0xed4dbb87898d4620 lrc: 3/0,0 mode: PW/PW res: [0x4869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453403:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e21c0/0xed4dbb87898d4620 lrc: 1/0,0 mode: --/PW res: [0x4869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453408:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e21c0/0xed4dbb87898d4620 lrc: 0/0,0 mode: --/PW res: [0x4869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453420:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.453421:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.453423:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.453450:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4868:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.453453:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1b00/0xed4dbb87898d4627 lrc: 3/0,1 mode: --/PW res: [0x4868:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453459:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.453460:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.453462:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1b00/0xed4dbb87898d4627 lrc: 3/0,1 mode: PW/PW res: [0x4868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453468:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1b00/0xed4dbb87898d4627 lrc: 3/0,1 mode: PW/PW res: [0x4868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453474:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1b00/0xed4dbb87898d4627 lrc: 3/0,1 mode: PW/PW res: [0x4868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453479:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1b00/0xed4dbb87898d4627 lrc: 2/0,0 mode: PW/PW res: [0x4868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453498:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1736271490.453503:0:10332:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ed580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:18282:x1820604024048832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 962us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271490.453509:0:10332:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121021 00010000:00010000:3.0:1736271490.453513:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.453516:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1b00/0xed4dbb87898d4627 lrc: 2/0,0 mode: PW/PW res: [0x4868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.453521:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e1b00 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.453522:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1b00/0xed4dbb87898d4627 lrc: 2/0,0 mode: PW/PW res: [0x4868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.453526:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1b00/0xed4dbb87898d4627 lrc: 3/0,0 mode: PW/PW res: [0x4868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.453534:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1b00/0xed4dbb87898d4627 lrc: 1/0,0 mode: --/PW res: [0x4868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1736271490.453539:0:18282:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ed0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18282:1820604024048832:0@lo:5:osp-pre-1-0.0 00002000:00010000:0.0:1736271490.453540:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4867:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1736271490.453540:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1b00/0xed4dbb87898d4627 lrc: 0/0,0 mode: --/PW res: [0x4868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453542:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2640/0xed4dbb87898d462e lrc: 3/0,1 mode: --/PW res: [0x4867:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453546:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1736271490.453546:0:18282:0:(osp_precreate.c:722:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x100010000:0x45e1:0x0]-[0x100010000:0x4601:0x0] 00010000:00010000:0.0:1736271490.453547:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.453548:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2640/0xed4dbb87898d462e lrc: 3/0,1 mode: PW/PW res: [0x4867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453552:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2640/0xed4dbb87898d462e lrc: 3/0,1 mode: PW/PW res: [0x4867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453555:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2640/0xed4dbb87898d462e lrc: 3/0,1 mode: PW/PW res: [0x4867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453560:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2640/0xed4dbb87898d462e lrc: 2/0,0 mode: PW/PW res: [0x4867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.453562:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.453563:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.453565:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1736271490.453567:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1736271490.453568:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2640/0xed4dbb87898d462e lrc: 3/0,0 mode: PW/PW res: [0x4867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.453572:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e2640 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.453574:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2640/0xed4dbb87898d462e lrc: 2/0,0 mode: PW/PW res: [0x4867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.453579:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2640/0xed4dbb87898d462e lrc: 3/0,0 mode: PW/PW res: [0x4867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.453588:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2640/0xed4dbb87898d462e lrc: 1/0,0 mode: --/PW res: [0x4867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.453593:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2640/0xed4dbb87898d462e lrc: 0/0,0 mode: --/PW res: [0x4867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736271490.453597:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4866:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.453600:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1440/0xed4dbb87898d4635 lrc: 3/0,1 mode: --/PW res: [0x4866:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453600:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.453603:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.453604:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271490.453605:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1736271490.453605:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271490.453606:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.453608:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1440/0xed4dbb87898d4635 lrc: 3/0,1 mode: PW/PW res: [0x4866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453623:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1440/0xed4dbb87898d4635 lrc: 3/0,1 mode: PW/PW res: [0x4866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453629:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1440/0xed4dbb87898d4635 lrc: 3/0,1 mode: PW/PW res: [0x4866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453634:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1440/0xed4dbb87898d4635 lrc: 2/0,0 mode: PW/PW res: [0x4866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453644:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.453651:0:24474:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.453653:0:24474:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1440/0xed4dbb87898d4635 lrc: 2/0,0 mode: PW/PW res: [0x4866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.453657:0:24474:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e1440 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.453662:0:24474:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1440/0xed4dbb87898d4635 lrc: 2/0,0 mode: PW/PW res: [0x4866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.453666:0:24474:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1440/0xed4dbb87898d4635 lrc: 3/0,0 mode: PW/PW res: [0x4866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.453673:0:24474:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1440/0xed4dbb87898d4635 lrc: 1/0,0 mode: --/PW res: [0x4866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.453675:0:24474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1440/0xed4dbb87898d4635 lrc: 0/0,0 mode: --/PW res: [0x4866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.453682:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.453683:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.453684:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.453694:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4865:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.453697:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1d40/0xed4dbb87898d463c lrc: 3/0,1 mode: --/PW res: [0x4865:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453703:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.453704:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.453706:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1d40/0xed4dbb87898d463c lrc: 3/0,1 mode: PW/PW res: [0x4865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453712:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1d40/0xed4dbb87898d463c lrc: 3/0,1 mode: PW/PW res: [0x4865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453718:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1d40/0xed4dbb87898d463c lrc: 3/0,1 mode: PW/PW res: [0x4865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453723:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1d40/0xed4dbb87898d463c lrc: 2/0,0 mode: PW/PW res: [0x4865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453749:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.453763:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.453765:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1d40/0xed4dbb87898d463c lrc: 2/0,0 mode: PW/PW res: [0x4865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453774:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e1d40 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.453775:0:9292:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1d40/0xed4dbb87898d463c lrc: 2/0,0 mode: PW/PW res: [0x4865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453779:0:9292:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1d40/0xed4dbb87898d463c lrc: 3/0,0 mode: PW/PW res: [0x4865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453786:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1d40/0xed4dbb87898d463c lrc: 1/0,0 mode: --/PW res: [0x4865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453788:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1d40/0xed4dbb87898d463c lrc: 0/0,0 mode: --/PW res: [0x4865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736271490.453797:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4864:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736271490.453797:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.453797:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.453798:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271490.453800:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0b40/0xed4dbb87898d4643 lrc: 3/0,1 mode: --/PW res: [0x4864:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453806:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.453807:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.453808:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0b40/0xed4dbb87898d4643 lrc: 3/0,1 mode: PW/PW res: [0x4864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453831:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0b40/0xed4dbb87898d4643 lrc: 3/0,1 mode: PW/PW res: [0x4864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453838:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0b40/0xed4dbb87898d4643 lrc: 3/0,1 mode: PW/PW res: [0x4864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453843:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0b40/0xed4dbb87898d4643 lrc: 2/0,0 mode: PW/PW res: [0x4864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453852:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.453858:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.453860:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0b40/0xed4dbb87898d4643 lrc: 2/0,0 mode: PW/PW res: [0x4864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453864:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e0b40 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.453865:0:6841:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0b40/0xed4dbb87898d4643 lrc: 2/0,0 mode: PW/PW res: [0x4864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453868:0:6841:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0b40/0xed4dbb87898d4643 lrc: 3/0,0 mode: PW/PW res: [0x4864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453881:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0b40/0xed4dbb87898d4643 lrc: 1/0,0 mode: --/PW res: [0x4864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453884:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0b40/0xed4dbb87898d4643 lrc: 0/0,0 mode: --/PW res: [0x4864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453893:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.453893:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.453894:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.453899:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4863:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.453902:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2d00/0xed4dbb87898d464a lrc: 3/0,1 mode: --/PW res: [0x4863:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453908:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.453909:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.453911:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2d00/0xed4dbb87898d464a lrc: 3/0,1 mode: PW/PW res: [0x4863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453926:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2d00/0xed4dbb87898d464a lrc: 3/0,1 mode: PW/PW res: [0x4863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453931:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2d00/0xed4dbb87898d464a lrc: 3/0,1 mode: PW/PW res: [0x4863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453936:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2d00/0xed4dbb87898d464a lrc: 2/0,0 mode: PW/PW res: [0x4863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.453944:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.453953:0:9291:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.453955:0:9291:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2d00/0xed4dbb87898d464a lrc: 2/0,0 mode: PW/PW res: [0x4863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453961:0:9291:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e2d00 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.453963:0:9291:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2d00/0xed4dbb87898d464a lrc: 2/0,0 mode: PW/PW res: [0x4863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453968:0:9291:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2d00/0xed4dbb87898d464a lrc: 3/0,0 mode: PW/PW res: [0x4863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453977:0:9291:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2d00/0xed4dbb87898d464a lrc: 1/0,0 mode: --/PW res: [0x4863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453982:0:9291:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2d00/0xed4dbb87898d464a lrc: 0/0,0 mode: --/PW res: [0x4863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736271490.453991:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4862:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736271490.453993:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271490.453995:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e33c0/0xed4dbb87898d4651 lrc: 3/0,1 mode: --/PW res: [0x4862:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.453998:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454000:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271490.454001:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454002:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454003:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e33c0/0xed4dbb87898d4651 lrc: 3/0,1 mode: PW/PW res: [0x4862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454010:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e33c0/0xed4dbb87898d4651 lrc: 3/0,1 mode: PW/PW res: [0x4862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454015:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e33c0/0xed4dbb87898d4651 lrc: 3/0,1 mode: PW/PW res: [0x4862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454020:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e33c0/0xed4dbb87898d4651 lrc: 2/0,0 mode: PW/PW res: [0x4862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454045:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.454074:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.454078:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e33c0/0xed4dbb87898d4651 lrc: 2/0,0 mode: PW/PW res: [0x4862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.454085:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e33c0 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.454087:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e33c0/0xed4dbb87898d4651 lrc: 2/0,0 mode: PW/PW res: [0x4862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.454093:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e33c0/0xed4dbb87898d4651 lrc: 3/0,0 mode: PW/PW res: [0x4862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736271490.454098:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4861:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.454101:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3180/0xed4dbb87898d4658 lrc: 3/0,1 mode: --/PW res: [0x4861:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.454103:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e33c0/0xed4dbb87898d4651 lrc: 1/0,0 mode: --/PW res: [0x4862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454108:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454109:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454110:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3180/0xed4dbb87898d4658 lrc: 3/0,1 mode: PW/PW res: [0x4861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454117:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3180/0xed4dbb87898d4658 lrc: 3/0,1 mode: PW/PW res: [0x4861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.454118:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e33c0/0xed4dbb87898d4651 lrc: 0/0,0 mode: --/PW res: [0x4862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454123:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3180/0xed4dbb87898d4658 lrc: 3/0,1 mode: PW/PW res: [0x4861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454128:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3180/0xed4dbb87898d4658 lrc: 2/0,0 mode: PW/PW res: [0x4861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.454131:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.454132:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.454134:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1736271490.454147:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1736271490.454148:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3180/0xed4dbb87898d4658 lrc: 3/0,0 mode: PW/PW res: [0x4861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.454154:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e3180 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.454155:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3180/0xed4dbb87898d4658 lrc: 2/0,0 mode: PW/PW res: [0x4861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.454161:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3180/0xed4dbb87898d4658 lrc: 3/0,0 mode: PW/PW res: [0x4861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.454170:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3180/0xed4dbb87898d4658 lrc: 1/0,0 mode: --/PW res: [0x4861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.454173:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3180/0xed4dbb87898d4658 lrc: 0/0,0 mode: --/PW res: [0x4861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454175:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.454181:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.454181:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.454182:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.454198:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4860:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.454201:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1f80/0xed4dbb87898d465f lrc: 3/0,1 mode: --/PW res: [0x4860:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454208:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454209:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454210:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1f80/0xed4dbb87898d465f lrc: 3/0,1 mode: PW/PW res: [0x4860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454226:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1f80/0xed4dbb87898d465f lrc: 3/0,1 mode: PW/PW res: [0x4860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454233:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1f80/0xed4dbb87898d465f lrc: 3/0,1 mode: PW/PW res: [0x4860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454238:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1f80/0xed4dbb87898d465f lrc: 2/0,0 mode: PW/PW res: [0x4860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454247:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.454253:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.454256:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1f80/0xed4dbb87898d465f lrc: 2/0,0 mode: PW/PW res: [0x4860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454278:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e1f80 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.454280:0:9292:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1f80/0xed4dbb87898d465f lrc: 2/0,0 mode: PW/PW res: [0x4860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454286:0:9292:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1f80/0xed4dbb87898d465f lrc: 3/0,0 mode: PW/PW res: [0x4860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454297:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1f80/0xed4dbb87898d465f lrc: 1/0,0 mode: --/PW res: [0x4860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454302:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e1f80/0xed4dbb87898d465f lrc: 0/0,0 mode: --/PW res: [0x4860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454314:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454315:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454316:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.454318:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x485f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.454321:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3a80/0xed4dbb87898d4666 lrc: 3/0,1 mode: --/PW res: [0x485f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454328:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454329:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454330:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3a80/0xed4dbb87898d4666 lrc: 3/0,1 mode: PW/PW res: [0x485f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454337:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3a80/0xed4dbb87898d4666 lrc: 3/0,1 mode: PW/PW res: [0x485f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454342:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3a80/0xed4dbb87898d4666 lrc: 3/0,1 mode: PW/PW res: [0x485f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454347:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3a80/0xed4dbb87898d4666 lrc: 2/0,0 mode: PW/PW res: [0x485f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454364:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.454371:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.454373:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3a80/0xed4dbb87898d4666 lrc: 2/0,0 mode: PW/PW res: [0x485f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454377:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e3a80 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.454378:0:6841:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3a80/0xed4dbb87898d4666 lrc: 2/0,0 mode: PW/PW res: [0x485f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454386:0:6841:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3a80/0xed4dbb87898d4666 lrc: 3/0,0 mode: PW/PW res: [0x485f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454392:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3a80/0xed4dbb87898d4666 lrc: 1/0,0 mode: --/PW res: [0x485f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454395:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e3a80/0xed4dbb87898d4666 lrc: 0/0,0 mode: --/PW res: [0x485f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454405:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454405:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454406:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.454414:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x485e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.454418:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0240/0xed4dbb87898d466d lrc: 3/0,1 mode: --/PW res: [0x485e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454424:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454425:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454426:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0240/0xed4dbb87898d466d lrc: 3/0,1 mode: PW/PW res: [0x485e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454433:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0240/0xed4dbb87898d466d lrc: 3/0,1 mode: PW/PW res: [0x485e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454439:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0240/0xed4dbb87898d466d lrc: 3/0,1 mode: PW/PW res: [0x485e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454443:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0240/0xed4dbb87898d466d lrc: 2/0,0 mode: PW/PW res: [0x485e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454452:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.454456:0:9291:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.454458:0:9291:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0240/0xed4dbb87898d466d lrc: 2/0,0 mode: PW/PW res: [0x485e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454461:0:9291:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e0240 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.454462:0:9291:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0240/0xed4dbb87898d466d lrc: 2/0,0 mode: PW/PW res: [0x485e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454465:0:9291:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0240/0xed4dbb87898d466d lrc: 3/0,0 mode: PW/PW res: [0x485e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454469:0:9291:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0240/0xed4dbb87898d466d lrc: 1/0,0 mode: --/PW res: [0x485e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454472:0:9291:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0240/0xed4dbb87898d466d lrc: 0/0,0 mode: --/PW res: [0x485e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454482:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454483:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454483:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.454500:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x485d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.454503:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0480/0xed4dbb87898d4674 lrc: 3/0,1 mode: --/PW res: [0x485d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454510:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454511:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454512:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0480/0xed4dbb87898d4674 lrc: 3/0,1 mode: PW/PW res: [0x485d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454528:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0480/0xed4dbb87898d4674 lrc: 3/0,1 mode: PW/PW res: [0x485d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454533:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0480/0xed4dbb87898d4674 lrc: 3/0,1 mode: PW/PW res: [0x485d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454538:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0480/0xed4dbb87898d4674 lrc: 2/0,0 mode: PW/PW res: [0x485d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454547:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.454552:0:24474:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.454553:0:24474:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0480/0xed4dbb87898d4674 lrc: 2/0,0 mode: PW/PW res: [0x485d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454556:0:24474:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e0480 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.454557:0:24474:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0480/0xed4dbb87898d4674 lrc: 2/0,0 mode: PW/PW res: [0x485d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454560:0:24474:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0480/0xed4dbb87898d4674 lrc: 3/0,0 mode: PW/PW res: [0x485d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454565:0:24474:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0480/0xed4dbb87898d4674 lrc: 1/0,0 mode: --/PW res: [0x485d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454567:0:24474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0480/0xed4dbb87898d4674 lrc: 0/0,0 mode: --/PW res: [0x485d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454573:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454573:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454574:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.454595:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x485c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.454598:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0000/0xed4dbb87898d467b lrc: 3/0,1 mode: --/PW res: [0x485c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454604:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454605:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454606:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0000/0xed4dbb87898d467b lrc: 3/0,1 mode: PW/PW res: [0x485c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454612:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0000/0xed4dbb87898d467b lrc: 3/0,1 mode: PW/PW res: [0x485c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454618:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0000/0xed4dbb87898d467b lrc: 3/0,1 mode: PW/PW res: [0x485c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454623:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0000/0xed4dbb87898d467b lrc: 2/0,0 mode: PW/PW res: [0x485c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454648:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.454676:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.454679:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0000/0xed4dbb87898d467b lrc: 2/0,0 mode: PW/PW res: [0x485c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.454690:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e0000 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.454692:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0000/0xed4dbb87898d467b lrc: 2/0,0 mode: PW/PW res: [0x485c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736271490.454696:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x485b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1736271490.454696:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0000/0xed4dbb87898d467b lrc: 3/0,0 mode: PW/PW res: [0x485c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454700:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2400/0xed4dbb87898d4682 lrc: 3/0,1 mode: --/PW res: [0x485b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.454703:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0000/0xed4dbb87898d467b lrc: 1/0,0 mode: --/PW res: [0x485c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.454705:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e0000/0xed4dbb87898d467b lrc: 0/0,0 mode: --/PW res: [0x485c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454706:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454707:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454708:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2400/0xed4dbb87898d4682 lrc: 3/0,1 mode: PW/PW res: [0x485b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454715:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2400/0xed4dbb87898d4682 lrc: 3/0,1 mode: PW/PW res: [0x485b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.454715:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.454716:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.454716:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271490.454721:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2400/0xed4dbb87898d4682 lrc: 3/0,1 mode: PW/PW res: [0x485b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454726:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2400/0xed4dbb87898d4682 lrc: 2/0,0 mode: PW/PW res: [0x485b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454745:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.454776:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.454779:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2400/0xed4dbb87898d4682 lrc: 2/0,0 mode: PW/PW res: [0x485b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454786:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e2400 already unused, calling callback (ffffffffa076c190) 00002000:00010000:0.0:1736271490.454792:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x485a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736271490.454792:0:9292:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2400/0xed4dbb87898d4682 lrc: 2/0,0 mode: PW/PW res: [0x485b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454795:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdb98c0/0xed4dbb87898d4689 lrc: 3/0,1 mode: --/PW res: [0x485a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454798:0:9292:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2400/0xed4dbb87898d4682 lrc: 3/0,0 mode: PW/PW res: [0x485b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454802:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454803:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454804:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdb98c0/0xed4dbb87898d4689 lrc: 3/0,1 mode: PW/PW res: [0x485a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454808:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2400/0xed4dbb87898d4682 lrc: 1/0,0 mode: --/PW res: [0x485b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454830:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1e2400/0xed4dbb87898d4682 lrc: 0/0,0 mode: --/PW res: [0x485b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454836:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdb98c0/0xed4dbb87898d4689 lrc: 3/0,1 mode: PW/PW res: [0x485a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454842:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdb98c0/0xed4dbb87898d4689 lrc: 3/0,1 mode: PW/PW res: [0x485a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454844:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454845:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454846:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271490.454847:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdb98c0/0xed4dbb87898d4689 lrc: 2/0,0 mode: PW/PW res: [0x485a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454856:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.454865:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.454867:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdb98c0/0xed4dbb87898d4689 lrc: 2/0,0 mode: PW/PW res: [0x485a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454873:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdb98c0 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.454874:0:6841:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdb98c0/0xed4dbb87898d4689 lrc: 2/0,0 mode: PW/PW res: [0x485a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454880:0:6841:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdb98c0/0xed4dbb87898d4689 lrc: 3/0,0 mode: PW/PW res: [0x485a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454889:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdb98c0/0xed4dbb87898d4689 lrc: 1/0,0 mode: --/PW res: [0x485a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454903:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdb98c0/0xed4dbb87898d4689 lrc: 0/0,0 mode: --/PW res: [0x485a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736271490.454905:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4859:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.454908:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8240/0xed4dbb87898d4690 lrc: 3/0,1 mode: --/PW res: [0x4859:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454915:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454916:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.454917:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8240/0xed4dbb87898d4690 lrc: 3/0,1 mode: PW/PW res: [0x4859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454918:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454919:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454920:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271490.454924:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8240/0xed4dbb87898d4690 lrc: 3/0,1 mode: PW/PW res: [0x4859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454929:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8240/0xed4dbb87898d4690 lrc: 3/0,1 mode: PW/PW res: [0x4859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454935:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8240/0xed4dbb87898d4690 lrc: 2/0,0 mode: PW/PW res: [0x4859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.454952:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.454957:0:9291:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.454958:0:9291:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8240/0xed4dbb87898d4690 lrc: 2/0,0 mode: PW/PW res: [0x4859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454962:0:9291:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdb8240 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.454963:0:9291:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8240/0xed4dbb87898d4690 lrc: 2/0,0 mode: PW/PW res: [0x4859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454967:0:9291:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8240/0xed4dbb87898d4690 lrc: 3/0,0 mode: PW/PW res: [0x4859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454972:0:9291:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8240/0xed4dbb87898d4690 lrc: 1/0,0 mode: --/PW res: [0x4859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454975:0:9291:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8240/0xed4dbb87898d4690 lrc: 0/0,0 mode: --/PW res: [0x4859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.454981:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454982:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.454982:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.455002:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4858:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.455005:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdbbcc0/0xed4dbb87898d4697 lrc: 3/0,1 mode: --/PW res: [0x4858:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455011:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455012:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455013:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdbbcc0/0xed4dbb87898d4697 lrc: 3/0,1 mode: PW/PW res: [0x4858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455020:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdbbcc0/0xed4dbb87898d4697 lrc: 3/0,1 mode: PW/PW res: [0x4858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455026:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdbbcc0/0xed4dbb87898d4697 lrc: 3/0,1 mode: PW/PW res: [0x4858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455031:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdbbcc0/0xed4dbb87898d4697 lrc: 2/0,0 mode: PW/PW res: [0x4858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455040:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.455044:0:24474:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.455049:0:24474:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdbbcc0/0xed4dbb87898d4697 lrc: 2/0,0 mode: PW/PW res: [0x4858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455052:0:24474:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdbbcc0 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.455054:0:24474:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdbbcc0/0xed4dbb87898d4697 lrc: 2/0,0 mode: PW/PW res: [0x4858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455057:0:24474:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdbbcc0/0xed4dbb87898d4697 lrc: 3/0,0 mode: PW/PW res: [0x4858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455061:0:24474:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdbbcc0/0xed4dbb87898d4697 lrc: 1/0,0 mode: --/PW res: [0x4858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455064:0:24474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdbbcc0/0xed4dbb87898d4697 lrc: 0/0,0 mode: --/PW res: [0x4858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455070:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455071:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455072:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.455087:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4857:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.455090:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d469e lrc: 3/0,1 mode: --/PW res: [0x4857:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455096:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455097:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455099:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d469e lrc: 3/0,1 mode: PW/PW res: [0x4857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455113:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d469e lrc: 3/0,1 mode: PW/PW res: [0x4857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455119:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d469e lrc: 3/0,1 mode: PW/PW res: [0x4857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455124:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d469e lrc: 2/0,0 mode: PW/PW res: [0x4857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455142:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.455166:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.455169:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d469e lrc: 2/0,0 mode: PW/PW res: [0x4857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.455174:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdbba80 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.455176:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d469e lrc: 2/0,0 mode: PW/PW res: [0x4857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.455181:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d469e lrc: 3/0,0 mode: PW/PW res: [0x4857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736271490.455189:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4856:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.455193:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaf40/0xed4dbb87898d46a5 lrc: 3/0,1 mode: --/PW res: [0x4856:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.455198:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d469e lrc: 1/0,0 mode: --/PW res: [0x4857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455199:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455200:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455202:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaf40/0xed4dbb87898d46a5 lrc: 3/0,1 mode: PW/PW res: [0x4856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.455202:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d469e lrc: 0/0,0 mode: --/PW res: [0x4857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455208:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaf40/0xed4dbb87898d46a5 lrc: 3/0,1 mode: PW/PW res: [0x4856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.455209:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.455210:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.455210:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271490.455214:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaf40/0xed4dbb87898d46a5 lrc: 3/0,1 mode: PW/PW res: [0x4856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455219:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaf40/0xed4dbb87898d46a5 lrc: 2/0,0 mode: PW/PW res: [0x4856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455244:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.455258:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.455271:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaf40/0xed4dbb87898d46a5 lrc: 2/0,0 mode: PW/PW res: [0x4856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455275:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdbaf40 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.455276:0:9292:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaf40/0xed4dbb87898d46a5 lrc: 2/0,0 mode: PW/PW res: [0x4856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455279:0:9292:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaf40/0xed4dbb87898d46a5 lrc: 3/0,0 mode: PW/PW res: [0x4856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455292:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaf40/0xed4dbb87898d46a5 lrc: 1/0,0 mode: --/PW res: [0x4856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455295:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaf40/0xed4dbb87898d46a5 lrc: 0/0,0 mode: --/PW res: [0x4856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455306:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455307:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455308:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.455311:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4855:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.455314:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdba880/0xed4dbb87898d46ac lrc: 3/0,1 mode: --/PW res: [0x4855:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455321:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455322:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455323:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdba880/0xed4dbb87898d46ac lrc: 3/0,1 mode: PW/PW res: [0x4855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455330:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdba880/0xed4dbb87898d46ac lrc: 3/0,1 mode: PW/PW res: [0x4855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455336:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdba880/0xed4dbb87898d46ac lrc: 3/0,1 mode: PW/PW res: [0x4855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455341:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdba880/0xed4dbb87898d46ac lrc: 2/0,0 mode: PW/PW res: [0x4855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455349:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.455353:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.455355:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdba880/0xed4dbb87898d46ac lrc: 2/0,0 mode: PW/PW res: [0x4855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455358:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdba880 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.455360:0:6841:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdba880/0xed4dbb87898d46ac lrc: 2/0,0 mode: PW/PW res: [0x4855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455363:0:6841:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdba880/0xed4dbb87898d46ac lrc: 3/0,0 mode: PW/PW res: [0x4855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455369:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdba880/0xed4dbb87898d46ac lrc: 1/0,0 mode: --/PW res: [0x4855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455371:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdba880/0xed4dbb87898d46ac lrc: 0/0,0 mode: --/PW res: [0x4855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455378:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455381:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455382:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.455391:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4854:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.455395:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdba400/0xed4dbb87898d46b3 lrc: 3/0,1 mode: --/PW res: [0x4854:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455401:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455402:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455403:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdba400/0xed4dbb87898d46b3 lrc: 3/0,1 mode: PW/PW res: [0x4854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455419:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdba400/0xed4dbb87898d46b3 lrc: 3/0,1 mode: PW/PW res: [0x4854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455425:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdba400/0xed4dbb87898d46b3 lrc: 3/0,1 mode: PW/PW res: [0x4854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455429:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdba400/0xed4dbb87898d46b3 lrc: 2/0,0 mode: PW/PW res: [0x4854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455438:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.455440:0:9291:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.455442:0:9291:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdba400/0xed4dbb87898d46b3 lrc: 2/0,0 mode: PW/PW res: [0x4854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455445:0:9291:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdba400 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.455446:0:9291:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdba400/0xed4dbb87898d46b3 lrc: 2/0,0 mode: PW/PW res: [0x4854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455449:0:9291:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdba400/0xed4dbb87898d46b3 lrc: 3/0,0 mode: PW/PW res: [0x4854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455454:0:9291:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdba400/0xed4dbb87898d46b3 lrc: 1/0,0 mode: --/PW res: [0x4854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455456:0:9291:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdba400/0xed4dbb87898d46b3 lrc: 0/0,0 mode: --/PW res: [0x4854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455462:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455463:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455463:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.455487:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4853:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.455490:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdba1c0/0xed4dbb87898d46ba lrc: 3/0,1 mode: --/PW res: [0x4853:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455496:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455497:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455498:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdba1c0/0xed4dbb87898d46ba lrc: 3/0,1 mode: PW/PW res: [0x4853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455504:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdba1c0/0xed4dbb87898d46ba lrc: 3/0,1 mode: PW/PW res: [0x4853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455510:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdba1c0/0xed4dbb87898d46ba lrc: 3/0,1 mode: PW/PW res: [0x4853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455515:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdba1c0/0xed4dbb87898d46ba lrc: 2/0,0 mode: PW/PW res: [0x4853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455533:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.455535:0:24474:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.455536:0:24474:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdba1c0/0xed4dbb87898d46ba lrc: 2/0,0 mode: PW/PW res: [0x4853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455539:0:24474:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdba1c0 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.455540:0:24474:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdba1c0/0xed4dbb87898d46ba lrc: 2/0,0 mode: PW/PW res: [0x4853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455548:0:24474:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdba1c0/0xed4dbb87898d46ba lrc: 3/0,0 mode: PW/PW res: [0x4853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455553:0:24474:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdba1c0/0xed4dbb87898d46ba lrc: 1/0,0 mode: --/PW res: [0x4853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455556:0:24474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdba1c0/0xed4dbb87898d46ba lrc: 0/0,0 mode: --/PW res: [0x4853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455562:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455562:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455563:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.455588:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4852:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.455591:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d46c1 lrc: 3/0,1 mode: --/PW res: [0x4852:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455597:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455598:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455600:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d46c1 lrc: 3/0,1 mode: PW/PW res: [0x4852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455607:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d46c1 lrc: 3/0,1 mode: PW/PW res: [0x4852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455612:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d46c1 lrc: 3/0,1 mode: PW/PW res: [0x4852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455617:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d46c1 lrc: 2/0,0 mode: PW/PW res: [0x4852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455634:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.455655:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.455658:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d46c1 lrc: 2/0,0 mode: PW/PW res: [0x4852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.455663:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdbaac0 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.455665:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d46c1 lrc: 2/0,0 mode: PW/PW res: [0x4852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.455670:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d46c1 lrc: 3/0,0 mode: PW/PW res: [0x4852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.455679:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d46c1 lrc: 1/0,0 mode: --/PW res: [0x4852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736271490.455680:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4851:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.455683:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8d80/0xed4dbb87898d46c8 lrc: 3/0,1 mode: --/PW res: [0x4851:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.455684:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d46c1 lrc: 0/0,0 mode: --/PW res: [0x4852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455689:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455690:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455692:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8d80/0xed4dbb87898d46c8 lrc: 3/0,1 mode: PW/PW res: [0x4851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.455692:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.455695:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.455696:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271490.455707:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8d80/0xed4dbb87898d46c8 lrc: 3/0,1 mode: PW/PW res: [0x4851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455713:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8d80/0xed4dbb87898d46c8 lrc: 3/0,1 mode: PW/PW res: [0x4851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455718:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8d80/0xed4dbb87898d46c8 lrc: 2/0,0 mode: PW/PW res: [0x4851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455735:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.455744:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.455746:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8d80/0xed4dbb87898d46c8 lrc: 2/0,0 mode: PW/PW res: [0x4851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455750:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdb8d80 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.455751:0:9292:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8d80/0xed4dbb87898d46c8 lrc: 2/0,0 mode: PW/PW res: [0x4851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455754:0:9292:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8d80/0xed4dbb87898d46c8 lrc: 3/0,0 mode: PW/PW res: [0x4851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455760:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8d80/0xed4dbb87898d46c8 lrc: 1/0,0 mode: --/PW res: [0x4851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455763:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8d80/0xed4dbb87898d46c8 lrc: 0/0,0 mode: --/PW res: [0x4851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455773:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455774:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455775:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.455785:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4850:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.455788:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8480/0xed4dbb87898d46cf lrc: 3/0,1 mode: --/PW res: [0x4850:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455795:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455796:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455797:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8480/0xed4dbb87898d46cf lrc: 3/0,1 mode: PW/PW res: [0x4850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455804:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8480/0xed4dbb87898d46cf lrc: 3/0,1 mode: PW/PW res: [0x4850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455810:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8480/0xed4dbb87898d46cf lrc: 3/0,1 mode: PW/PW res: [0x4850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455832:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8480/0xed4dbb87898d46cf lrc: 2/0,0 mode: PW/PW res: [0x4850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455850:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.455852:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.455853:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8480/0xed4dbb87898d46cf lrc: 2/0,0 mode: PW/PW res: [0x4850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455857:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdb8480 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.455858:0:6841:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8480/0xed4dbb87898d46cf lrc: 2/0,0 mode: PW/PW res: [0x4850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455861:0:6841:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8480/0xed4dbb87898d46cf lrc: 3/0,0 mode: PW/PW res: [0x4850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455866:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8480/0xed4dbb87898d46cf lrc: 1/0,0 mode: --/PW res: [0x4850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455868:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8480/0xed4dbb87898d46cf lrc: 0/0,0 mode: --/PW res: [0x4850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455874:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455874:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455875:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.455898:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x484f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.455901:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9d40/0xed4dbb87898d46d6 lrc: 3/0,1 mode: --/PW res: [0x484f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455908:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455909:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.455910:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9d40/0xed4dbb87898d46d6 lrc: 3/0,1 mode: PW/PW res: [0x484f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455917:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9d40/0xed4dbb87898d46d6 lrc: 3/0,1 mode: PW/PW res: [0x484f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455923:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9d40/0xed4dbb87898d46d6 lrc: 3/0,1 mode: PW/PW res: [0x484f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455928:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9d40/0xed4dbb87898d46d6 lrc: 2/0,0 mode: PW/PW res: [0x484f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.455937:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.455938:0:9291:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.455940:0:9291:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9d40/0xed4dbb87898d46d6 lrc: 2/0,0 mode: PW/PW res: [0x484f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455943:0:9291:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdb9d40 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.455947:0:9291:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9d40/0xed4dbb87898d46d6 lrc: 2/0,0 mode: PW/PW res: [0x484f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455950:0:9291:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9d40/0xed4dbb87898d46d6 lrc: 3/0,0 mode: PW/PW res: [0x484f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455955:0:9291:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9d40/0xed4dbb87898d46d6 lrc: 1/0,0 mode: --/PW res: [0x484f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455958:0:9291:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9d40/0xed4dbb87898d46d6 lrc: 0/0,0 mode: --/PW res: [0x484f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.455963:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455964:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.455965:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736271490.456039:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x484e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.456041:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdbb600/0xed4dbb87898d46dd lrc: 3/0,1 mode: --/PW res: [0x484e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456046:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.456046:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.456047:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdbb600/0xed4dbb87898d46dd lrc: 3/0,1 mode: PW/PW res: [0x484e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456058:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdbb600/0xed4dbb87898d46dd lrc: 3/0,1 mode: PW/PW res: [0x484e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456061:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdbb600/0xed4dbb87898d46dd lrc: 3/0,1 mode: PW/PW res: [0x484e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456064:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdbb600/0xed4dbb87898d46dd lrc: 2/0,0 mode: PW/PW res: [0x484e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456077:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.456081:0:24474:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.456084:0:24474:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdbb600/0xed4dbb87898d46dd lrc: 2/0,0 mode: PW/PW res: [0x484e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.456088:0:24474:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdbb600 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.456089:0:24474:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdbb600/0xed4dbb87898d46dd lrc: 2/0,0 mode: PW/PW res: [0x484e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.456095:0:24474:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdbb600/0xed4dbb87898d46dd lrc: 3/0,0 mode: PW/PW res: [0x484e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.456103:0:24474:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdbb600/0xed4dbb87898d46dd lrc: 1/0,0 mode: --/PW res: [0x484e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736271490.456113:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x484d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736271490.456114:0:24474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdbb600/0xed4dbb87898d46dd lrc: 0/0,0 mode: --/PW res: [0x484e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456116:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8000/0xed4dbb87898d46e4 lrc: 3/0,1 mode: --/PW res: [0x484d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456122:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.456122:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736271490.456122:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.456122:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.456123:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271490.456124:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8000/0xed4dbb87898d46e4 lrc: 3/0,1 mode: PW/PW res: [0x484d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456130:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8000/0xed4dbb87898d46e4 lrc: 3/0,1 mode: PW/PW res: [0x484d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456135:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8000/0xed4dbb87898d46e4 lrc: 3/0,1 mode: PW/PW res: [0x484d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456140:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8000/0xed4dbb87898d46e4 lrc: 2/0,0 mode: PW/PW res: [0x484d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456166:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271490.456198:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271490.456201:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8000/0xed4dbb87898d46e4 lrc: 2/0,0 mode: PW/PW res: [0x484d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.456206:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdb8000 already unused, calling callback (ffffffffa076c190) 00010000:00010000:3.0:1736271490.456207:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8000/0xed4dbb87898d46e4 lrc: 2/0,0 mode: PW/PW res: [0x484d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.456211:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8000/0xed4dbb87898d46e4 lrc: 3/0,0 mode: PW/PW res: [0x484d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736271490.456216:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x484c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1736271490.456218:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8000/0xed4dbb87898d46e4 lrc: 1/0,0 mode: --/PW res: [0x484d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456219:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdbad00/0xed4dbb87898d46eb lrc: 3/0,1 mode: --/PW res: [0x484c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.456221:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdb8000/0xed4dbb87898d46e4 lrc: 0/0,0 mode: --/PW res: [0x484d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456225:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.456227:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.456228:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdbad00/0xed4dbb87898d46eb lrc: 3/0,1 mode: PW/PW res: [0x484c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271490.456229:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.456230:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271490.456231:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271490.456235:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdbad00/0xed4dbb87898d46eb lrc: 3/0,1 mode: PW/PW res: [0x484c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456241:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdbad00/0xed4dbb87898d46eb lrc: 3/0,1 mode: PW/PW res: [0x484c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456246:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdbad00/0xed4dbb87898d46eb lrc: 2/0,0 mode: PW/PW res: [0x484c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456277:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.456308:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.456311:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdbad00/0xed4dbb87898d46eb lrc: 2/0,0 mode: PW/PW res: [0x484c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.456318:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdbad00 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.456319:0:9292:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdbad00/0xed4dbb87898d46eb lrc: 2/0,0 mode: PW/PW res: [0x484c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.456324:0:9292:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdbad00/0xed4dbb87898d46eb lrc: 3/0,0 mode: PW/PW res: [0x484c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736271490.456325:0:9275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x484b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736271490.456328:0:9275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9f80/0xed4dbb87898d46f2 lrc: 3/0,1 mode: --/PW res: [0x484b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.456331:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdbad00/0xed4dbb87898d46eb lrc: 1/0,0 mode: --/PW res: [0x484c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.456333:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdbad00/0xed4dbb87898d46eb lrc: 0/0,0 mode: --/PW res: [0x484c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456334:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.456335:0:9275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736271490.456336:0:9275:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9f80/0xed4dbb87898d46f2 lrc: 3/0,1 mode: PW/PW res: [0x484b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.456341:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.456342:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.456343:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271490.456349:0:9275:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9f80/0xed4dbb87898d46f2 lrc: 3/0,1 mode: PW/PW res: [0x484b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456355:0:9275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9f80/0xed4dbb87898d46f2 lrc: 3/0,1 mode: PW/PW res: [0x484b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456359:0:9275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9f80/0xed4dbb87898d46f2 lrc: 2/0,0 mode: PW/PW res: [0x484b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271490.456367:0:9275:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271490.456371:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271490.456376:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9f80/0xed4dbb87898d46f2 lrc: 2/0,0 mode: PW/PW res: [0x484b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.456379:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdb9f80 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271490.456380:0:6841:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9f80/0xed4dbb87898d46f2 lrc: 2/0,0 mode: PW/PW res: [0x484b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.456383:0:6841:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9f80/0xed4dbb87898d46f2 lrc: 3/0,0 mode: PW/PW res: [0x484b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.456388:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9f80/0xed4dbb87898d46f2 lrc: 1/0,0 mode: --/PW res: [0x484b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.456391:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cdb9f80/0xed4dbb87898d46f2 lrc: 0/0,0 mode: --/PW res: [0x484b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271490.456397:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.456398:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271490.456399:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1736271490.456402:0:9275:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x0:18506 00000100:00100000:0.0:1736271490.456436:0:9275:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b13440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:18280:x1820604024048640:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9039us (9082us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271490.456441:0:9275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121020 00000100:00100000:2.0:1736271490.456445:0:18280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a7d2d0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18280:1820604024048640:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1736271490.456451:0:18280:0:(osp_precreate.c:953:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x4869:0x0] from OST, last_created [0x100000000:0x4869:0x0]last_used is [0x100000000:0x484a:0x0] 00000100:00100000:2.0:1736271490.456491:0:18280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934edf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18280:1820604024048960:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1736271490.456508:0:18280:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271490.456515:0:18280:0:(client.c:2492:ptlrpc_set_wait()) set ffff880089ac8840 going to sleep for 20 seconds 00000100:00100000:3.0:1736271490.456520:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271490.456524:0:9275:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024048960 00000100:00100000:3.0:1736271490.456530:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1820604024048896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1736271490.456541:0:9275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121022 00000100:00100000:0.0:1736271490.456545:0:9275:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ee3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:18280:x1820604024048960:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:0.0:1736271490.456548:0:9275:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1736271490.456555:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1736271490.456563:0:9275:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x0 at 18538 00000100:00100000:2.0:1736271490.456573:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024048896 00000100:00100000:2.0:1736271490.456590:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5745 00000100:00100000:2.0:1736271490.456594:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb12ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3333:x1820604024048896:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:2.0:1736271490.456604:0:11119:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1736271490.456612:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8655040 pending 896 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271490.456636:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb12ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3333:x1820604024048896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271490.456642:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5745 00000100:00100000:3.0:1736271490.456652:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1820604024048896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1736271490.457500:0:9275:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ee3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:18280:x1820604024048960:12345-0@lo:5:osp-pre-0-0.0 Request processed in 954us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271490.457504:0:9275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121022 00000100:00100000:2.0:1736271490.457529:0:18280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934edf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18280:1820604024048960:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1736271490.457536:0:18280:0:(osp_precreate.c:722:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x100000000:0x4869:0x0]-[0x100000000:0x4889:0x0] 00000100:00100000:0.0:1736271490.646466:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1820604024049024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1736271490.646526:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271490.646600:0:8909:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049024 00000100:00100000:1.0:1736271490.646639:0:8909:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112744 00000100:00100000:1.0:1736271490.646645:0:8909:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b13dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3335:x1820604024049024:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:1.0:1736271490.646650:0:8909:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1736271490.646673:0:8909:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445720064 avail 1316257792 00000100:00100000:1.0:1736271490.646718:0:8909:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b13dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3335:x1820604024049024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271490.646725:0:8909:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112744 00000100:00100000:0.0:1736271490.646752:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1820604024049024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1736271490.662452:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b15f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1820604024049280:0@lo:400:kworker/u8:3.0 00000100:00100000:2.0:1736271490.662452:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024049088:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271490.662477:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b15580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1820604024049152:0@lo:400:kworker/u8:3.0 00000100:00100000:0.0:1736271490.662492:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024049216:0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1736271490.662510:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271490.662510:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271490.662534:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271490.662535:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049088 00000100:00100000:1.0:1736271490.662538:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d5504c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3335:1820604024049536:0@lo:400:kworker/u8:3.0 00000100:00100000:2.0:1736271490.662542:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b117c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024049344:0@lo:400:kworker/u8:3.0 00000100:00100000:0.0:1736271490.662551:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aafa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024049472:0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1736271490.662555:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271490.662576:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1736271490.662578:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049280 00000100:00100000:3.0:1736271490.662580:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+23:3336:x1820604024049088:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:0.0:1736271490.662583:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:02000000:3.0:1736271490.662585:0:18267:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1736271490.662594:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049216 00000100:00100000:2.0:1736271490.662597:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049536 00000100:00100000:0.0:1736271490.662608:0:9275:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049472 00000100:00100000:2.0:1736271490.662609:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1736271490.662613:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b789300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1820604024049280:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:2.0:1736271490.662617:0:27148:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1736271490.662617:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+23:3336:x1820604024049088:12345-0@lo:400:kworker/u8:3.0 Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271490.662622:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:3.0:1736271490.662623:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1736271490.662626:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b78da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3335:x1820604024049536:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:0.0:1736271490.662627:0:9275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6941 00000100:00100000:0.0:1736271490.662630:0:9275:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d5576c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024049472:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:1.0:1736271490.662630:0:27149:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:0.0:1736271490.662634:0:9275:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1736271490.662644:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b789300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1820604024049280:12345-0@lo:400:kworker/u8:3.0 Request processed in 31us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271490.662650:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1736271490.662652:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b78da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3335:x1820604024049536:12345-0@lo:400:kworker/u8:3.0 Request processed in 26us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271490.662654:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:1.0:1736271490.662657:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:3.0:1736271490.662658:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d552ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024049216:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:3.0:1736271490.662661:0:27660:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1736271490.662666:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271490.662669:0:9275:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d5576c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024049472:12345-0@lo:400:kworker/u8:3.0 Request processed in 38us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271490.662675:0:9275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6941 00000100:00100000:2.0:1736271490.662679:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d557200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1820604024049600:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271490.662679:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d552ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024049216:12345-0@lo:400:kworker/u8:3.0 Request processed in 21us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271490.662680:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d5504c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3335:1820604024049536:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271490.662682:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:1.0:1736271490.662686:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b15f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1820604024049280:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271490.662691:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049344 00000100:00100000:2.0:1736271490.662698:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271490.662701:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024049216:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271490.662703:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049600 00000100:00100000:1.0:1736271490.662706:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:1.0:1736271490.662709:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934edf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024049344:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:0.0:1736271490.662710:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aafa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024049472:0@lo:400:kworker/u8:3.0 00000020:02000000:1.0:1736271490.662711:0:3854:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1736271490.662712:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024049088:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271490.662714:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:3.0:1736271490.662717:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1820604024049600:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:3.0:1736271490.662719:0:27660:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1736271490.662725:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934edf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024049344:12345-0@lo:400:kworker/u8:3.0 Request processed in 16us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271490.662728:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1736271490.662738:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b117c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024049344:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271490.662740:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1820604024049600:12345-0@lo:400:kworker/u8:3.0 Request processed in 22us (42us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271490.662745:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1736271490.662747:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d557200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1820604024049600:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271490.662760:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271490.662771:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024049408:0@lo:400:kworker/u8:3.0 00000100:00100000:0.0:1736271490.662775:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049152 00000100:00100000:3.0:1736271490.662787:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271490.662797:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1736271490.662800:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb104c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1820604024049152:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:0.0:1736271490.662804:0:27660:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736271490.662848:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb104c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1820604024049152:12345-0@lo:400:kworker/u8:3.0 Request processed in 47us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271490.662854:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1736271490.662865:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b15580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1820604024049152:0@lo:400:kworker/u8:3.0 00000100:00100000:0.0:1736271490.662868:0:9275:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049408 00000100:00100000:0.0:1736271490.662879:0:9275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6942 00000100:00100000:0.0:1736271490.662882:0:9275:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084663900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024049408:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:0.0:1736271490.662885:0:9275:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736271490.662913:0:9275:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084663900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024049408:12345-0@lo:400:kworker/u8:3.0 Request processed in 30us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271490.662919:0:9275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6942 00000100:00100000:3.0:1736271490.662925:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024049408:0@lo:400:kworker/u8:3.0 00010000:00010000:2.0:1736271491.158440:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1736271491.387384:0:9284:0:(ldlm_lib.c:3016:target_queue_recovery_request()) @@@ queue final req req@ffff8800934eaf80 x1820604024048576/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1736271500 ref 2 fl Interpret:/c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' 00000100:00100000:2.0:1736271491.387467:0:9284:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934eaf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3332:x1820604024048576:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 999656us (999720us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271491.387474:0:9284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112743 00000100:00080000:0.0:1736271491.387504:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1736271491.387509:0:3332:0:(client.c:2972:ptlrpc_resend_req()) @@@ going to resend req@ffff8800934ebdc0 x1820604024048576/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1736271520 ref 1 fl Interpret:RQU/c0/0 rc 0/0 job:'ptlrpcd_rcv.0' 00000100:00080000:0.0:1736271491.387514:0:3332:0:(client.c:2981:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8800934ebdc0 x1820604024048576/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1736271520 ref 1 fl Interpret:RQU/c0/0 rc 0/0 job:'ptlrpcd_rcv.0' 00000100:00080000:0.0:1736271491.387518:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1736271491.387532:0:3332:0:(import.c:1644:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to (at 0@lo) 00000100:00080000:0.0:1736271491.387536:0:3332:0:(recover.c:218:ptlrpc_wake_delayed()) @@@ waking (set ffff8800b529aa80): req@ffff88008c8a1c80 x1820604024007808/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1736271315 ref 1 fl Rpc:RSQU/0/0 rc -107/-107 job:'osp-pre-0-1.0' 00000100:00100000:0.0:1736271491.387550:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ebdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024048576:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1736271491.387588:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271491.387595:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271491.387603:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084661300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024049664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1736271491.387610:0:9284:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024007808 00000100:00100000:0.0:1736271491.387629:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271491.387643:0:9284:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049664 00000100:00100000:2.0:1736271491.387651:0:9284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112745 00000100:00100000:2.0:1736271491.387654:0:9284:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934eed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3333:x1820604024007808:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1736271491.387657:0:9284:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1736271491.387670:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112746 00000004:00000024:2.0:1736271491.387677:0:9284:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445253120 avail 1315790848 00000100:00100000:3.0:1736271491.387685:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d557200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3334:x1820604024049664:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:3.0:1736271491.387689:0:27356:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1736271491.387696:0:9284:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934eed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3333:x1820604024007808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271491.387699:0:9284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112745 00000004:00000024:3.0:1736271491.387700:0:27356:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445253120 avail 1315790848 00000100:00100000:2.0:1736271491.387714:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024007808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1736271491.387727:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d557200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024049664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 41us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271491.387732:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112746 00000100:00100000:0.0:1736271491.387739:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084661300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024049664:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1736271492.160430:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271493.162433:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271494.164451:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271494.358460:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ef200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024049792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271494.358518:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271494.358546:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d5504c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024049728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271494.358564:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271494.358568:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049792 00000100:00100000:2.0:1736271494.358611:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049728 00000100:00100000:2.0:1736271494.358629:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5746 00000100:00100000:2.0:1736271494.358634:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b14740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024049792:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271494.358637:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5747 00000020:02000000:2.0:1736271494.358640:0:11119:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736271494.358643:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b15580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024049728:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:0.0:1736271494.358647:0:9277:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1736271494.358661:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271494.358661:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271494.358709:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b15580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024049728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271494.358713:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b14740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024049792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271494.358715:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5747 00000100:00100000:1.0:1736271494.358731:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ef200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024049792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271494.358733:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5746 00000100:00100000:1.0:1736271494.358743:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d5504c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024049728:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271495.166463:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271495.436592:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271495.436647:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271495.436681:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058961664 00000100:00100000:0.0:1736271495.436704:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271495.436732:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058961792 00000100:00100000:0.0:1736271495.436734:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271495.436741:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:3.0:1736271495.436748:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058961664:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000020:02000000:3.0:1736271495.436755:0:18269:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736271495.436757:0:9275:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058961856 00000100:00100000:1.0:1736271495.436764:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058961728 00000100:00100000:1.0:1736271495.436779:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 612 00000100:00100000:0.0:1736271495.436799:0:10332:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6943 00000100:00100000:1.0:1736271495.436801:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d5504c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058961792:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271495.436803:0:10332:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a1c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058961856:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000020:02000000:0.0:1736271495.436806:0:10332:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:1.0:1736271495.436811:0:27660:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736271495.436835:0:10332:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a1c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058961856:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271495.436835:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058961664:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 86us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271495.436836:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d5504c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058961792:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 35us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271495.436839:0:10332:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6943 00000100:00100000:1.0:1736271495.436842:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 612 00000100:00100000:3.0:1736271495.436843:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:1.0:1736271495.436853:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 817 00000100:00100000:1.0:1736271495.436857:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058961728:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000020:02000000:1.0:1736271495.436860:0:27660:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:1.0:1736271495.436879:0:27660:0:(ldlm_lib.c:1370:target_handle_connect()) lustre-MDT0000: connection from 64bb3b11-afd7-4230-a38c-2a374f07ba02@192.168.203.38@tcp t18446612135152703584 exp (null) cur 8280 last 0 00000020:00000080:1.0:1736271495.436928:0:27660:0:(genops.c:1359:class_connect()) connect: client 64bb3b11-afd7-4230-a38c-2a374f07ba02, cookie 0xed4dbb87898d46f9 00000004:00100000:1.0:1736271495.436948:0:27660:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1736271495.436953:0:27660:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 123, last_transno is 528280977408 00000020:01000000:1.0:1736271495.438589:0:27660:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash ffff8800906e5240 00000100:00080000:1.0:1736271495.438619:0:27660:0:(import.c:86:import_set_state_nolock()) ffff88009be2f800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1736271495.438656:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1891:x1820604058961728:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 1797us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271495.438663:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 817 00000100:00100000:3.0:1736271495.462519:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1736271495.462540:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ef6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024049856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1736271495.462607:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271495.462634:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b117c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024049920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1736271495.462649:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271495.462652:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049856 00000100:00100000:2.0:1736271495.462686:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049920 00000100:00100000:0.0:1736271495.462697:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5748 00000100:00100000:0.0:1736271495.462704:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084662140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024049856:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1736271495.462704:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5749 00000020:02000000:0.0:1736271495.462709:0:9277:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1736271495.462709:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084662600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024049920:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:3.0:1736271495.462713:0:9278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1736271495.462728:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3906641920 avail 3675119616 00002000:00000024:3.0:1736271495.462728:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271495.462766:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084662600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024049920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271495.462773:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084662140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024049856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271495.462773:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5749 00000100:00100000:2.0:1736271495.462812:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ef6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024049856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1736271495.462824:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b117c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024049920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1736271495.462828:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5748 00000100:00100000:2.0:1736271495.654485:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024049984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1736271495.654544:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271495.654593:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024049984 00000100:00100000:3.0:1736271495.654640:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112747 00000100:00100000:3.0:1736271495.654645:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024049984:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:3.0:1736271495.654652:0:27356:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1736271495.654682:0:27356:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445720064 avail 1316257792 00000100:00100000:3.0:1736271495.654733:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024049984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271495.654740:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112747 00000100:00100000:2.0:1736271495.654751:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024049984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1736271495.670510:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024050048:0@lo:400:kworker/u8:3.0 00000100:00100000:2.0:1736271495.670544:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c480980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024050176:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271495.670581:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271495.670590:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271495.670598:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c481300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1820604024050240:0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1736271495.670607:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1820604024050112:0@lo:400:kworker/u8:3.0 00000100:00100000:2.0:1736271495.670612:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c483dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024050432:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271495.670615:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c481c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024050304:0@lo:400:kworker/u8:3.0 00000100:00100000:0.0:1736271495.670633:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271495.670634:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271495.670655:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050048 00000100:00100000:0.0:1736271495.670667:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c484740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024050496:0@lo:400:kworker/u8:3.0 00000100:00100000:2.0:1736271495.670672:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c484c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1820604024050688:0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1736271495.670676:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271495.670688:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1736271495.670693:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271495.670694:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+23:3333:x1820604024050048:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:3.0:1736271495.670699:0:18269:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736271495.670706:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050176 00000100:00100000:1.0:1736271495.670708:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c483900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024050368:0@lo:400:kworker/u8:3.0 00000100:00100000:2.0:1736271495.670726:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271495.670735:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271495.670738:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+23:3333:x1820604024050048:12345-0@lo:400:kworker/u8:3.0 Request processed in 44us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271495.670744:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1736271495.670749:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050240 00000100:00100000:2.0:1736271495.670751:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5776c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024050752:0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1736271495.670752:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c485f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1820604024050624:0@lo:400:kworker/u8:3.0 00000100:00100000:0.0:1736271495.670765:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050112 00000100:00100000:1.0:1736271495.670776:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271495.670791:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271495.670792:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1736271495.670795:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271495.670797:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ef200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024050176:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:0.0:1736271495.670801:0:27149:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1736271495.670802:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c485580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3333:1820604024050560:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271495.670821:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271495.670829:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b571300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1820604024050816:0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1736271495.670830:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050304 00000100:00100000:0.0:1736271495.670835:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ef200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024050176:12345-0@lo:400:kworker/u8:3.0 Request processed in 38us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271495.670840:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271495.670846:0:23103:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050432 00000100:00100000:1.0:1736271495.670854:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050560 00000100:00100000:3.0:1736271495.670857:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024050048:0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1736271495.670861:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050816 00000100:00100000:0.0:1736271495.670870:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1736271495.670872:0:23103:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050688 00000100:00100000:1.0:1736271495.670881:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:1.0:1736271495.670885:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1820604024050240:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:2.0:1736271495.670886:0:23103:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050496 00000100:00100000:0.0:1736271495.670889:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000020:02000000:1.0:1736271495.670889:0:3854:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1736271495.670890:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050752 00000100:00100000:0.0:1736271495.670893:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b13900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1820604024050112:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:0.0:1736271495.670896:0:27149:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1736271495.670901:0:23103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6944 00000100:00100000:2.0:1736271495.670905:0:23103:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ebdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024050432:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:2.0:1736271495.670910:0:23103:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1736271495.670914:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6945 00000100:00100000:3.0:1736271495.670917:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3335:x1820604024050688:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:3.0:1736271495.670921:0:23102:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736271495.670932:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b13900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1820604024050112:12345-0@lo:400:kworker/u8:3.0 Request processed in 38us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271495.670934:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1820604024050240:12345-0@lo:400:kworker/u8:3.0 Request processed in 48us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271495.670937:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1736271495.670940:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1736271495.670948:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1736271495.670950:0:23103:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ebdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024050432:12345-0@lo:400:kworker/u8:3.0 Request processed in 42us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271495.670950:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3335:x1820604024050688:12345-0@lo:400:kworker/u8:3.0 Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271495.670952:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:0.0:1736271495.670953:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846663c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024050304:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1736271495.670954:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846676c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3333:x1820604024050560:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:0.0:1736271495.670956:0:27149:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:1.0:1736271495.670956:0:3854:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1736271495.670956:0:23103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6944 00000100:00100000:3.0:1736271495.670959:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6945 00000100:00100000:3.0:1736271495.670970:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6946 00000100:00100000:1.0:1736271495.670971:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846676c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3333:x1820604024050560:12345-0@lo:400:kworker/u8:3.0 Request processed in 17us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271495.670973:0:23103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6947 00000100:00100000:1.0:1736271495.670974:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1736271495.670974:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ed0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024050496:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:2.0:1736271495.670977:0:23103:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ecc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024050752:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:3.0:1736271495.670977:0:23102:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:2.0:1736271495.670980:0:23103:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1736271495.670981:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:1.0:1736271495.670982:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084667200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1820604024050816:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:1.0:1736271495.670984:0:3854:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736271495.670995:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846663c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024050304:12345-0@lo:400:kworker/u8:3.0 Request processed in 36us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271495.671001:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:1.0:1736271495.671003:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084667200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1820604024050816:12345-0@lo:400:kworker/u8:3.0 Request processed in 20us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271495.671007:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:2.0:1736271495.671009:0:23103:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ecc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024050752:12345-0@lo:400:kworker/u8:3.0 Request processed in 32us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271495.671012:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ed0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024050496:12345-0@lo:400:kworker/u8:3.0 Request processed in 38us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271495.671015:0:23103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6947 00000100:00100000:3.0:1736271495.671018:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6946 00000100:00100000:1.0:1736271495.671031:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1820604024050112:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271495.671040:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050368 00000100:00100000:2.0:1736271495.671044:0:9284:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050624 00000100:00100000:3.0:1736271495.671060:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112748 00000100:00100000:3.0:1736271495.671063:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b16880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024050368:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:0.0:1736271495.671065:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c481300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1820604024050240:0@lo:400:kworker/u8:3.0 00000100:00100000:2.0:1736271495.671065:0:9284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112749 00000020:02000000:3.0:1736271495.671067:0:27356:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1736271495.671070:0:9284:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e6a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3334:x1820604024050624:12345-0@lo:400:kworker/u8:3.0 00000020:02000000:2.0:1736271495.671073:0:9284:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736271495.671074:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c484740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024050496:0@lo:400:kworker/u8:3.0 00000100:00100000:0.0:1736271495.671083:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b5776c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024050752:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271495.671107:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b16880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024050368:12345-0@lo:400:kworker/u8:3.0 Request processed in 42us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271495.671113:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112748 00000100:00100000:2.0:1736271495.671114:0:9284:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e6a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3334:x1820604024050624:12345-0@lo:400:kworker/u8:3.0 Request processed in 43us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271495.671120:0:9284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112749 00000100:00100000:1.0:1736271495.671125:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c483900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024050368:0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1736271495.671132:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c485f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1820604024050624:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271495.671140:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c481c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024050304:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271495.671150:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c485580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3333:1820604024050560:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271495.671159:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b571300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1820604024050816:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271495.671362:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c484c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1820604024050688:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271495.671372:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c480980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024050176:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1736271495.671387:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c483dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024050432:0@lo:400:kworker/u8:3.0 00010000:00010000:2.0:1736271496.168397:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271496.390425:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024050880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1736271496.390540:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271496.390588:0:9284:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050880 00000100:00100000:2.0:1736271496.390623:0:9284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112750 00000100:00100000:2.0:1736271496.390626:0:9284:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b15f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024050880:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1736271496.390631:0:9284:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1736271496.390655:0:9284:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445253120 avail 1315790848 00000100:00100000:2.0:1736271496.390706:0:9284:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b15f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024050880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271496.390713:0:9284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112750 00000100:00100000:1.0:1736271496.390739:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024050880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1736271496.666237:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271496.666309:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058961920 00000100:00100000:2.0:1736271496.666356:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 818 00000100:00100000:2.0:1736271496.666374:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fba140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:13507:x1820604058961920:12345-192.168.203.38@tcp:101:lfs.0 00000020:02000000:2.0:1736271496.666380:0:27660:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:2.0:1736271496.666394:0:27660:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1736271496.666412:0:27660:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903a80/0xed4dbb87898d4700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252fa6fdbb94bc96 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1736271496.666880:0:27660:0:(mdt_identity.c:116:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 429us 00010000:00010000:2.0:1736271496.668935:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902d00/0xed4dbb87898d4707 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271496.668947:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902d00/0xed4dbb87898d4707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271496.668958:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902d00/0xed4dbb87898d4707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1736271496.671099:0:27660:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1736271496.671104:0:27660:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 185 stripe count 1 MDT count 8 00000004:00010000:0.0:1736271496.671133:0:27660:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902d00/0xed4dbb87898d4707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.671152:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903a80/0xed4dbb87898d4700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bc96 expref: 8 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.671182:0:27660:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902d00/0xed4dbb87898d4707 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bc96 expref: 7 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.671187:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009d222900) 00010000:00010000:0.0:1736271496.671189:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1736271496.671190:0:27660:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012f902d00, rc 0) 00000100:00100000:0.0:1736271496.671228:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fba140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+7:13507:x1820604058961920:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 4855us (4998us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271496.671233:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 818 00000100:00100000:0.0:1736271496.672744:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271496.672803:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058961984 00000100:00100000:2.0:1736271496.672830:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 819 00000100:00100000:2.0:1736271496.672834:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+7:13507:x1820604058961984:12345-192.168.203.38@tcp:41:lfs.0 00000020:02000000:2.0:1736271496.672837:0:27660:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1736271496.672854:0:27660:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445253120 avail 1315790848 00000100:00100000:2.0:1736271496.672879:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+7:13507:x1820604058961984:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 45us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271496.672883:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 819 00000100:00100000:2.0:1736271496.673512:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271496.673549:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058962048 00000100:00100000:0.0:1736271496.673570:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 820 00000100:00100000:0.0:1736271496.673574:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934eaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:13507:x1820604058962048:12345-192.168.203.38@tcp:41:lfs.0 00000020:02000000:0.0:1736271496.673576:0:27660:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1736271496.673591:0:27660:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445720064 avail 1316257792 00000100:00100000:0.0:1736271496.673613:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934eaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:13507:x1820604058962048:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 40us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271496.673617:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 820 00000100:00100000:3.0:1736271496.674382:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271496.674420:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058962112 00000100:00100000:0.0:1736271496.674448:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5750 00000100:00100000:0.0:1736271496.674452:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084662f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:13507:x1820604058962112:12345-192.168.203.38@tcp:13:lfs.0 00000020:02000000:0.0:1736271496.674456:0:9277:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1736271496.674472:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271496.674508:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084662f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:13507:x1820604058962112:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 55us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271496.674519:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5750 00000100:00100000:0.0:1736271496.675216:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271496.675252:0:21062:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058962176 00000100:00100000:2.0:1736271496.675287:0:21062:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 121023 00000100:00100000:2.0:1736271496.675290:0:21062:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:1891:x1820604058962176:12345-192.168.203.38@tcp:8:lfs.0 00000020:02000000:2.0:1736271496.675297:0:21062:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:2.0:1736271496.675310:0:21062:0:(ldlm_lib.c:1370:target_handle_connect()) lustre-OST0001: connection from 64bb3b11-afd7-4230-a38c-2a374f07ba02@192.168.203.38@tcp t0 exp (null) cur 8282 last 0 00000020:00000080:2.0:1736271496.675326:0:21062:0:(genops.c:1359:class_connect()) connect: client 64bb3b11-afd7-4230-a38c-2a374f07ba02, cookie 0xed4dbb87898d470e 00002000:00100000:2.0:1736271496.675332:0:21062:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli 64bb3b11-afd7-4230-a38c-2a374f07ba02/ffff88009c9f6000 ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0600 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1736271496.675342:0:21062:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:01000000:2.0:1736271496.675380:0:21062:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash ffff8800906e4f00 00002000:00080000:2.0:1736271496.675385:0:21062:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1736271496.675400:0:21062:0:(import.c:86:import_set_state_nolock()) ffff88009c9f5800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from RECOVER to FULL 00000100:00100000:2.0:1736271496.675427:0:21062:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1891:x1820604058962176:12345-192.168.203.38@tcp:8:lfs.0 Request processed in 136us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271496.675431:0:21062:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 121023 00000100:00100000:0.0:1736271496.676015:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271496.676054:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058962240 00000100:00100000:2.0:1736271496.676077:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5751 00000100:00100000:2.0:1736271496.676081:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbd580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:13507:x1820604058962240:12345-192.168.203.38@tcp:13:lfs.0 00000020:02000000:2.0:1736271496.676085:0:9277:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1736271496.676093:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8577856 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271496.676125:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbd580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:13507:x1820604058962240:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 43us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271496.676130:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5751 00000100:00100000:3.0:1736271496.680755:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271496.680806:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058962304 00000100:00100000:0.0:1736271496.680831:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 821 00000100:00100000:0.0:1736271496.680834:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084664c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+7:12882:x1820604058962304:12345-192.168.203.38@tcp:101:multiop.0 00000020:02000000:0.0:1736271496.680837:0:27660:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1736271496.680845:0:27660:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1736271496.680859:0:27660:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdb8000/0xed4dbb87898d4715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252fa6fdbb94bc9d expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.680902:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d471c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.680913:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d471c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.680921:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d471c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.680933:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d4723 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.680939:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d4723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.680944:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d4723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681076:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdb8900/0xed4dbb87898d472a lrc: 3/1,0 mode: --/PR res: [0x20003bd21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681083:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdb8900/0xed4dbb87898d472a lrc: 3/1,0 mode: PR/PR res: [0x20003bd21:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681089:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdb8900/0xed4dbb87898d472a lrc: 3/1,0 mode: PR/PR res: [0x20003bd21:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1736271496.681113:0:27660:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20003bd21:0x1:0x0]: returning size 0 00000004:00200000:0.0:1736271496.681116:0:27660:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1736271496.681137:0:27660:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdb8900/0xed4dbb87898d472a lrc: 3/1,0 mode: PR/PR res: [0x20003bd21:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681146:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdb8900/0xed4dbb87898d472a lrc: 3/1,0 mode: PR/PR res: [0x20003bd21:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681152:0:27660:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d471c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681157:0:27660:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d471c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681161:0:27660:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d471c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681166:0:27660:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdbaac0 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:0.0:1736271496.681169:0:27660:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d471c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681183:0:27660:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d471c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681193:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009d222900) 00010000:00010000:0.0:1736271496.681196:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1736271496.681198:0:27660:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d471c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681203:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbaac0/0xed4dbb87898d471c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681227:0:27660:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d4723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681232:0:27660:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d4723 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681237:0:27660:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d4723 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681240:0:27660:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cdbba80 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:0.0:1736271496.681241:0:27660:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d4723 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681245:0:27660:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d4723 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681250:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d214928 (ffff8800845cfb00) 00010000:00010000:0.0:1736271496.681252:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1736271496.681258:0:27660:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d4723 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681284:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbba80/0xed4dbb87898d4723 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681308:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdb8000/0xed4dbb87898d4715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bc9d expref: 9 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681316:0:27660:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdb8900/0xed4dbb87898d472a lrc: 3/0,0 mode: PR/PR res: [0x20003bd21:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bc9d expref: 8 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271496.681321:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003bd21:0x1:0x0].0x0 (ffff8800845cf100) 00010000:00010000:0.0:1736271496.681322:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1736271496.681324:0:27660:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008cdb8900, rc 0) 00000100:00100000:0.0:1736271496.681361:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084664c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+8:12882:x1820604058962304:12345-192.168.203.38@tcp:101:multiop.0 Request processed in 525us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271496.681367:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 821 00010000:00010000:2.0:1736271497.170374:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271497.300548:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271497.300610:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058962432 00000100:00100000:1.0:1736271497.300646:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 822 00000100:00100000:1.0:1736271497.300652:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fb9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+8:13629:x1820604058962432:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1736271497.300689:0:27660:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1736271497.300711:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdb8900/0xed4dbb87898d472a lrc: 0/0,0 mode: --/PR res: [0x20003bd21:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bc9d expref: 8 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.300725:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003bd21:0x1:0x0].0x0 (ffff8800845cf100) 00010000:00010000:1.0:1736271497.300738:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902d00/0xed4dbb87898d4707 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bc96 expref: 7 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.300745:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009d222900) 00010000:00010000:1.0:1736271497.300749:0:27660:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1736271497.300786:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a40fc0/0xed4dbb87898d4731 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.300797:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a40fc0/0xed4dbb87898d4731 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.300809:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a40fc0/0xed4dbb87898d4731 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.300818:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43cc0/0xed4dbb87898d4738 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5d214928 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.300824:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43cc0/0xed4dbb87898d4738 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.300829:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43cc0/0xed4dbb87898d4738 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.300901:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43600/0xed4dbb87898d473f lrc: 3/0,1 mode: --/EX res: [0x20003bd21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.300908:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43600/0xed4dbb87898d473f lrc: 3/0,1 mode: EX/EX res: [0x20003bd21:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.300914:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43600/0xed4dbb87898d473f lrc: 3/0,1 mode: EX/EX res: [0x20003bd21:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1736271497.301099:0:27660:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x1ec:0x0].2, 64 off8320 00000004:00080000:1.0:1736271497.301104:0:27660:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8282637842294ns, next at 8283637840799ns, rc = 0 00010000:00010000:1.0:1736271497.301143:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a42ac0/0xed4dbb87898d4746 lrc: 3/0,1 mode: --/PW res: [0x20003bd21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.301151:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a42ac0/0xed4dbb87898d4746 lrc: 3/0,1 mode: PW/PW res: [0x20003bd21:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.301158:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a42ac0/0xed4dbb87898d4746 lrc: 3/0,1 mode: PW/PW res: [0x20003bd21:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.301164:0:27660:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a42ac0/0xed4dbb87898d4746 lrc: 4/0,1 mode: PW/PW res: [0x20003bd21:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.301169:0:27660:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a42ac0/0xed4dbb87898d4746 lrc: 4/0,1 mode: PW/PW res: [0x20003bd21:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.301174:0:27660:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099a42ac0/0xed4dbb87898d4746 lrc: 3/0,0 mode: PW/PW res: [0x20003bd21:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.301206:0:27660:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1736271497.301229:0:27660:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff880074fb9c80 reply state ffff88009d287000 transno 528280977409 ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43600/0xed4dbb87898d473f lrc: 3/0,1 mode: EX/EX res: [0x20003bd21:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271497.301234:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271497.301238:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099a42ac0/0xed4dbb87898d4746 lrc: 2/0,0 mode: PW/PW res: [0x20003bd21:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271497.301246:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099a42ac0 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271497.301249:0:6840:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a42ac0/0xed4dbb87898d4746 lrc: 2/0,0 mode: PW/PW res: [0x20003bd21:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271497.301283:0:6840:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a42ac0/0xed4dbb87898d4746 lrc: 3/0,0 mode: PW/PW res: [0x20003bd21:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271497.301293:0:6840:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003bd21:0x1:0x0].0x0 (ffff88009d363800) 00010000:00010000:2.0:1736271497.301294:0:6840:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1736271497.301296:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099a42ac0/0xed4dbb87898d4746 lrc: 1/0,0 mode: --/PW res: [0x20003bd21:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271497.301299:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a42ac0/0xed4dbb87898d4746 lrc: 0/0,0 mode: --/PW res: [0x20003bd21:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271497.301307:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271497.301307:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271497.301308:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271497.301329:0:27660:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a40fc0/0xed4dbb87898d4731 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.301335:0:27660:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099a40fc0/0xed4dbb87898d4731 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.301341:0:27660:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099a40fc0/0xed4dbb87898d4731 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.301345:0:27660:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099a40fc0 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:1.0:1736271497.301353:0:27660:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a40fc0/0xed4dbb87898d4731 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.301358:0:27660:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a40fc0/0xed4dbb87898d4731 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.301365:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009d363500) 00010000:00010000:1.0:1736271497.301367:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1736271497.301369:0:27660:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099a40fc0/0xed4dbb87898d4731 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271497.301373:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a40fc0/0xed4dbb87898d4731 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1736271497.301383:0:27660:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff880074fb9c80 reply state ffff88009d287000 transno 528280977409 ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43cc0/0xed4dbb87898d4738 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1736271497.301449:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fb9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+8:13629:x1820604058962432:12345-192.168.203.38@tcp:36:rm.0 Request processed in 796us (905us total) trans 528280977409 rc 0/0 00000100:00100000:1.0:1736271497.301455:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 822 00010000:00010000:2.0:1736271497.302236:0:3320:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43cc0/0xed4dbb87898d4738 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271497.302244:0:3320:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d214928 (ffff88009d363600) 00010000:00010000:2.0:1736271497.302246:0:3320:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736271497.302249:0:3320:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43600/0xed4dbb87898d473f lrc: 3/0,1 mode: COS/COS res: [0x20003bd21:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271497.302254:0:3320:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003bd21:0x1:0x0].0x0 (ffff88009d363800) 00010000:00010000:2.0:1736271497.302255:0:3320:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1736271498.172450:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1736271498.955373:0:19293:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1736271498.955377:0:19293:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 12:38:18 (1736271498) 00010000:00010000:3.0:1736271499.174371:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1736271499.210382:0:10487:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64bb3b11-afd7-4230-a38c-2a374f07ba02 00000001:00080000:0.0:1736271499.210427:0:18263:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 528280977409 is committed 00000004:00080000:0.0:1736271499.210433:0:18263:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1736271499.210442:0:3319:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43cc0/0xed4dbb87898d4738 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000001:00100000:0.0:1736271499.210447:0:18263:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 64bb3b11-afd7-4230-a38c-2a374f07ba02 00010000:00010000:2.0:1736271499.210457:0:3319:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43cc0/0xed4dbb87898d4738 lrc: 2/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.210461:0:3319:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43cc0/0xed4dbb87898d4738 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.210465:0:3319:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099a43cc0 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:2.0:1736271499.210467:0:3319:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43cc0/0xed4dbb87898d4738 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.210472:0:3319:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43cc0/0xed4dbb87898d4738 lrc: 4/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.210482:0:3319:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d214928 (ffff88009d363600) 00010000:00010000:2.0:1736271499.210484:0:3319:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736271499.210485:0:3319:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43cc0/0xed4dbb87898d4738 lrc: 2/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.210489:0:3319:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43cc0/0xed4dbb87898d4738 lrc: 0/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.210498:0:3319:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43600/0xed4dbb87898d473f lrc: 3/0,1 mode: COS/COS res: [0x20003bd21:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.210501:0:3319:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43600/0xed4dbb87898d473f lrc: 2/0,0 mode: COS/COS res: [0x20003bd21:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.210504:0:3319:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43600/0xed4dbb87898d473f lrc: 3/0,0 mode: COS/COS res: [0x20003bd21:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1736271499.210506:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1736271499.210512:0:3319:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099a43600 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:2.0:1736271499.210513:0:3319:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43600/0xed4dbb87898d473f lrc: 3/0,0 mode: COS/COS res: [0x20003bd21:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.210515:0:3319:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43600/0xed4dbb87898d473f lrc: 4/0,0 mode: COS/COS res: [0x20003bd21:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.210519:0:3319:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003bd21:0x1:0x0].0x0 (ffff88009d363800) 00010000:00010000:2.0:1736271499.210520:0:3319:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1736271499.210521:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b10980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024050944:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1736271499.210521:0:3319:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43600/0xed4dbb87898d473f lrc: 2/0,0 mode: --/COS res: [0x20003bd21:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.210523:0:3319:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a43600/0xed4dbb87898d473f lrc: 0/0,0 mode: --/COS res: [0x20003bd21:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1736271499.210582:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271499.210602:0:21062:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024050944 00000100:00100000:2.0:1736271499.210624:0:21062:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121024 00000100:00100000:2.0:1736271499.210627:0:21062:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024050944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1736271499.210643:0:21062:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:18506 count 1 00010000:00010000:2.0:1736271499.210656:0:21062:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f902d00/0xed4dbb87898d474d lrc: 3/0,1 mode: --/PW res: [0x484a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21062 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.210667:0:21062:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d42fb lrc: 2/0,0 mode: PR/PR res: [0x484a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bc6c expref: 5 pid: 23098 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1736271499.210673:0:21062:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736271499.210674:0:21062:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736271499.210676:0:21062:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f902d00/0xed4dbb87898d474d lrc: 4/0,1 mode: --/PW res: [0x484a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21062 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.210704:0:21062:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d42fb lrc: 3/0,0 mode: PR/PR res: [0x484a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bc6c expref: 5 pid: 23098 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1736271499.210714:0:21062:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d42fb lrc: 4/0,0 mode: PR/PR res: [0x484a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bc6c expref: 5 pid: 23098 timeout: 8384 lvb_type: 1 00000100:00100000:2.0:1736271499.210724:0:21062:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21062:1820604024051008:192.168.203.38@tcp:104: 00000100:00100000:2.0:1736271499.210790:0:21062:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4a7f180 going to sleep for 11 seconds 00000100:00100000:2.0:1736271499.211871:0:21062:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21062:1820604024051008:192.168.203.38@tcp:104: 00010000:00010000:2.0:1736271499.211885:0:21062:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f902d00/0xed4dbb87898d474d lrc: 3/0,1 mode: --/PW res: [0x484a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21062 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1736271499.212175:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271499.212230:0:16574:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058962496 00010000:00010000:1.0:1736271499.212243:0:16574:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d42fb lrc: 4/0,0 mode: PR/PR res: [0x484a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bc6c expref: 6 pid: 23098 timeout: 8384 lvb_type: 1 00000100:00100000:1.0:1736271499.212281:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 94861 00000100:00100000:1.0:1736271499.212284:0:16574:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131023050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1892:x1820604058962496:12345-192.168.203.38@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1736271499.212290:0:16574:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1736271499.212292:0:16574:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d42fb lrc: 4/0,0 mode: PR/PR res: [0x484a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bc6c expref: 6 pid: 23098 timeout: 8384 lvb_type: 1 00010000:00010000:1.0:1736271499.212298:0:16574:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d42fb lrc: 3/0,0 mode: PR/PR res: [0x484a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bc6c expref: 6 pid: 23098 timeout: 8384 lvb_type: 1 00010000:00010000:1.0:1736271499.212310:0:16574:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d42fb lrc: 0/0,0 mode: --/PR res: [0x484a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bc6c expref: 6 pid: 23098 timeout: 8384 lvb_type: 1 00010000:00010000:1.0:1736271499.212316:0:16574:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271499.212317:0:16574:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736271499.212319:0:16574:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f902d00/0xed4dbb87898d474d lrc: 3/0,1 mode: PW/PW res: [0x484a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271499.212334:0:16574:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f902d00/0xed4dbb87898d474d lrc: 4/0,1 mode: PW/PW res: [0x484a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271499.212351:0:16574:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1736271499.212377:0:21062:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f902d00/0xed4dbb87898d474d lrc: 3/0,1 mode: PW/PW res: [0x484a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21062 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1736271499.212380:0:16574:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131023050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1892:x1820604058962496:12345-192.168.203.38@tcp:103:ldlm_bl_01.0 Request processed in 95us (206us total) trans 0 rc 0/0 00010000:00010000:3.0:1736271499.212385:0:21062:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f902d00/0xed4dbb87898d474d lrc: 3/0,1 mode: PW/PW res: [0x484a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21062 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1736271499.212387:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 94861 00010000:00010000:3.0:1736271499.212390:0:21062:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f902d00/0xed4dbb87898d474d lrc: 3/0,1 mode: PW/PW res: [0x484a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21062 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.212395:0:21062:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f902d00/0xed4dbb87898d474d lrc: 2/0,0 mode: PW/PW res: [0x484a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21062 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.212406:0:21062:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271499.212416:0:9291:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736271499.212420:0:9291:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f902d00/0xed4dbb87898d474d lrc: 2/0,0 mode: PW/PW res: [0x484a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21062 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.212425:0:9291:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012f902d00 already unused, calling callback (ffffffffa076c190) 00010000:00010000:2.0:1736271499.212427:0:9291:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f902d00/0xed4dbb87898d474d lrc: 2/0,0 mode: PW/PW res: [0x484a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21062 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.212430:0:9291:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f902d00/0xed4dbb87898d474d lrc: 3/0,0 mode: PW/PW res: [0x484a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21062 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.212438:0:9291:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f902d00/0xed4dbb87898d474d lrc: 1/0,0 mode: --/PW res: [0x484a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21062 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.212445:0:9291:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f902d00/0xed4dbb87898d474d lrc: 0/0,0 mode: --/PW res: [0x484a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21062 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.212462:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271499.212462:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271499.212463:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271499.212551:0:21062:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3336:x1820604024050944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1922us (1970us total) trans 85899347174 rc 0/0 00000100:00100000:3.0:1736271499.212557:0:21062:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121024 00000004:00080000:0.0:1736271499.212562:0:3336:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880131b10980/2, rc 0, transno 1254 00000100:00100000:0.0:1736271499.212567:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b10980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024050944:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1736271499.214974:0:25514:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 85899347174 is committed 00000100:00100000:3.0:1736271499.225794:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271499.225838:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058962560 00000100:00100000:1.0:1736271499.225869:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 823 00000100:00100000:1.0:1736271499.225873:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084662ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:14271:x1820604058962560:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1736271499.225885:0:27660:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1736271499.225897:0:27660:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a433c0/0xed4dbb87898d4754 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252fa6fdbb94bca4 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271499.225933:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a41d40/0xed4dbb87898d475b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271499.225941:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a41d40/0xed4dbb87898d475b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271499.225947:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a41d40/0xed4dbb87898d475b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1736271499.225975:0:27660:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1736271499.225976:0:27660:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 184 stripe count 1 MDT count 8 00000004:00010000:1.0:1736271499.225987:0:27660:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099a41d40/0xed4dbb87898d475b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271499.226007:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a433c0/0xed4dbb87898d4754 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bca4 expref: 7 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271499.226015:0:27660:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a41d40/0xed4dbb87898d475b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bca4 expref: 6 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271499.226019:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009d363300) 00010000:00010000:1.0:1736271499.226020:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1736271499.226022:0:27660:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099a41d40, rc 0) 00000100:00100000:1.0:1736271499.226059:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084662ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:14271:x1820604058962560:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 186us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271499.226063:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 823 00000100:00100000:1.0:1736271499.227351:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271499.227366:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058962624 00000100:00100000:1.0:1736271499.227386:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 824 00000100:00100000:1.0:1736271499.227389:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b13dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:14271:x1820604058962624:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:1.0:1736271499.227403:0:27660:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445253120 avail 1315790848 00000100:00100000:1.0:1736271499.227427:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b13dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:14271:x1820604058962624:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 38us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271499.227431:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 824 00000100:00100000:0.0:1736271499.227983:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271499.228069:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058962688 00000100:00100000:1.0:1736271499.228099:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 825 00000100:00100000:1.0:1736271499.228103:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b577200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:14271:x1820604058962688:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:1.0:1736271499.228119:0:27660:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445720064 avail 1316257792 00000100:00100000:1.0:1736271499.228151:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b577200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:14271:x1820604058962688:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 48us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271499.228160:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 825 00000100:00100000:0.0:1736271499.229040:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271499.229090:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058962752 00000100:00100000:2.0:1736271499.229124:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5752 00000100:00100000:2.0:1736271499.229128:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:14271:x1820604058962752:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1736271499.229146:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271499.229185:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:14271:x1820604058962752:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 56us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271499.229191:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5752 00000100:00100000:0.0:1736271499.229842:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271499.229895:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058962816 00000100:00100000:2.0:1736271499.229924:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5753 00000100:00100000:2.0:1736271499.229928:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5776c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:14271:x1820604058962816:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1736271499.229943:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8577856 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271499.229972:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5776c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:14271:x1820604058962816:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 43us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271499.229978:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5753 00000100:00100000:0.0:1736271499.243166:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271499.243234:0:27156:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058962880 00000100:00100000:1.0:1736271499.243281:0:27156:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:1.0:1736271499.243285:0:27156:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c483dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:14278:x1820604058962880:12345-192.168.203.38@tcp:700:mcreate.0 00000100:00100000:1.0:1736271499.243337:0:27156:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c483dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:14278:x1820604058962880:12345-192.168.203.38@tcp:700:mcreate.0 Request processed in 52us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271499.243342:0:27156:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1736271499.244312:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271499.244333:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058963008 00000100:00100000:3.0:1736271499.244356:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 826 00000100:00100000:3.0:1736271499.244361:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084666880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:14278:x1820604058963008:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00010000:3.0:1736271499.244391:0:27660:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1736271499.244419:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a41d40/0xed4dbb87898d475b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bca4 expref: 6 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.244433:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009d363300) 00010000:00010000:3.0:1736271499.244440:0:27660:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1736271499.244500:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9998c0/0xed4dbb87898d4762 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.244512:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9998c0/0xed4dbb87898d4762 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.244521:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9998c0/0xed4dbb87898d4762 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.244530:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99a880/0xed4dbb87898d4769 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1931768a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.244536:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99a880/0xed4dbb87898d4769 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.244542:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99a880/0xed4dbb87898d4769 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.244839:0:27660:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9998c0/0xed4dbb87898d4762 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.244847:0:27660:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9998c0/0xed4dbb87898d4762 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.244853:0:27660:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9998c0/0xed4dbb87898d4762 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.244867:0:27660:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a9998c0 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:3.0:1736271499.244870:0:27660:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9998c0/0xed4dbb87898d4762 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.244875:0:27660:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9998c0/0xed4dbb87898d4762 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.244883:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800acc62c00) 00010000:00010000:3.0:1736271499.244885:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1736271499.244887:0:27660:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9998c0/0xed4dbb87898d4762 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271499.244891:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9998c0/0xed4dbb87898d4762 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1736271499.244902:0:27660:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff880084666880 reply state ffff88012e3ed800 transno 528280977410 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99a880/0xed4dbb87898d4769 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1736271499.244954:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084666880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+7:14278:x1820604058963008:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 592us (644us total) trans 528280977410 rc 0/0 00000100:00100000:3.0:1736271499.244960:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 826 00010000:00010000:2.0:1736271499.245682:0:3320:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99a880/0xed4dbb87898d4769 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.245690:0:3320:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1931768a (ffff8800acc62400) 00010000:00010000:2.0:1736271499.245692:0:3320:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1736271499.251101:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271499.251141:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058963072 00000100:00100000:0.0:1736271499.251169:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 827 00000100:00100000:0.0:1736271499.251172:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084661300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+7:14281:x1820604058963072:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:0.0:1736271499.251186:0:27660:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1736271499.251196:0:27660:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdb9200/0xed4dbb87898d4770 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252fa6fdbb94bcab expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271499.251237:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbb180/0xed4dbb87898d4777 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271499.251244:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbb180/0xed4dbb87898d4777 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271499.251250:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbb180/0xed4dbb87898d4777 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1736271499.251285:0:27660:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1736271499.251287:0:27660:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 185 stripe count 1 MDT count 8 00000004:00010000:0.0:1736271499.251298:0:27660:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbb180/0xed4dbb87898d4777 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271499.251311:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdb9200/0xed4dbb87898d4770 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcab expref: 9 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271499.251321:0:27660:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbb180/0xed4dbb87898d4777 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcab expref: 8 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271499.251337:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880094cf0100) 00010000:00010000:0.0:1736271499.251339:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1736271499.251341:0:27660:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008cdbb180, rc 0) 00000100:00100000:0.0:1736271499.251386:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084661300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+8:14281:x1820604058963072:12345-192.168.203.38@tcp:101:rm.0 Request processed in 211us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271499.251390:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 827 00000100:00100000:0.0:1736271499.252203:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271499.252238:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058963136 00000100:00100000:2.0:1736271499.252275:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 828 00000100:00100000:2.0:1736271499.252278:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c480980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+8:14281:x1820604058963136:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1736271499.252284:0:27660:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1736271499.252290:0:27660:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902d00/0xed4dbb87898d477e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252fa6fdbb94bcb2 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252307:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d4785 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252312:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d4785 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252317:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d4785 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252321:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903a80/0xed4dbb87898d478c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1931768a bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252325:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903a80/0xed4dbb87898d478c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252328:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903a80/0xed4dbb87898d478c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252378:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f901f80/0xed4dbb87898d4793 lrc: 3/1,0 mode: --/PR res: [0x20003c4f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252382:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f901f80/0xed4dbb87898d4793 lrc: 3/1,0 mode: PR/PR res: [0x20003c4f1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252392:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f901f80/0xed4dbb87898d4793 lrc: 3/1,0 mode: PR/PR res: [0x20003c4f1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1736271499.252409:0:27660:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20003c4f1:0x1:0x0]: returning size 0 00000004:00200000:2.0:1736271499.252411:0:27660:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1736271499.252418:0:27660:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f901f80/0xed4dbb87898d4793 lrc: 3/1,0 mode: PR/PR res: [0x20003c4f1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252422:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f901f80/0xed4dbb87898d4793 lrc: 3/1,0 mode: PR/PR res: [0x20003c4f1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252426:0:27660:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d4785 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252429:0:27660:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d4785 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252432:0:27660:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d4785 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252435:0:27660:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012f900fc0 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:2.0:1736271499.252437:0:27660:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d4785 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252440:0:27660:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d4785 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252445:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880094cf0100) 00010000:00010000:2.0:1736271499.252446:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736271499.252450:0:27660:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d4785 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252453:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900fc0/0xed4dbb87898d4785 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252458:0:27660:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903a80/0xed4dbb87898d478c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252461:0:27660:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903a80/0xed4dbb87898d478c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252464:0:27660:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903a80/0xed4dbb87898d478c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252467:0:27660:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012f903a80 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:2.0:1736271499.252467:0:27660:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903a80/0xed4dbb87898d478c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252470:0:27660:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903a80/0xed4dbb87898d478c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252473:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1931768a (ffff8800acc62400) 00010000:00010000:2.0:1736271499.252474:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736271499.252475:0:27660:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903a80/0xed4dbb87898d478c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252478:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903a80/0xed4dbb87898d478c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252488:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902d00/0xed4dbb87898d477e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcb2 expref: 10 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252497:0:27660:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f901f80/0xed4dbb87898d4793 lrc: 3/0,0 mode: PR/PR res: [0x20003c4f1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcb2 expref: 9 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.252501:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003c4f1:0x1:0x0].0x0 (ffff88012e176c00) 00010000:00010000:2.0:1736271499.252502:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1736271499.252503:0:27660:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012f901f80, rc 0) 00000100:00100000:2.0:1736271499.252529:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c480980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+9:14281:x1820604058963136:12345-192.168.203.38@tcp:101:rm.0 Request processed in 250us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271499.252533:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 828 00000100:00100000:1.0:1736271499.253483:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271499.253535:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058963264 00000100:00100000:2.0:1736271499.253564:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 829 00000100:00100000:2.0:1736271499.253568:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b16880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+9:14281:x1820604058963264:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1736271499.253588:0:27660:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1736271499.253599:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f901f80/0xed4dbb87898d4793 lrc: 0/0,0 mode: --/PR res: [0x20003c4f1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcb2 expref: 9 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253608:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003c4f1:0x1:0x0].0x0 (ffff88012e176c00) 00010000:00010000:2.0:1736271499.253612:0:27660:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1736271499.253622:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900b40/0xed4dbb87898d479a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253628:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900b40/0xed4dbb87898d479a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253634:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900b40/0xed4dbb87898d479a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253651:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902400/0xed4dbb87898d47a1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1931768a bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253657:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902400/0xed4dbb87898d47a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253663:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902400/0xed4dbb87898d47a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253695:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900900/0xed4dbb87898d47a8 lrc: 3/0,1 mode: --/EX res: [0x20003c4f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253701:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900900/0xed4dbb87898d47a8 lrc: 3/0,1 mode: EX/EX res: [0x20003c4f1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253705:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900900/0xed4dbb87898d47a8 lrc: 3/0,1 mode: EX/EX res: [0x20003c4f1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253827:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9033c0/0xed4dbb87898d47af lrc: 3/0,1 mode: --/PW res: [0x20003c4f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253832:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9033c0/0xed4dbb87898d47af lrc: 3/0,1 mode: PW/PW res: [0x20003c4f1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253836:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9033c0/0xed4dbb87898d47af lrc: 3/0,1 mode: PW/PW res: [0x20003c4f1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253840:0:27660:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9033c0/0xed4dbb87898d47af lrc: 4/0,1 mode: PW/PW res: [0x20003c4f1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253849:0:27660:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9033c0/0xed4dbb87898d47af lrc: 4/0,1 mode: PW/PW res: [0x20003c4f1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253852:0:27660:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9033c0/0xed4dbb87898d47af lrc: 3/0,0 mode: PW/PW res: [0x20003c4f1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253869:0:27660:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1736271499.253878:0:27660:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff880131b16880 reply state ffff880131ad9000 transno 528280977411 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900900/0xed4dbb87898d47a8 lrc: 3/0,1 mode: EX/EX res: [0x20003c4f1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271499.253901:0:24474:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1736271499.253905:0:24474:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9033c0/0xed4dbb87898d47af lrc: 2/0,0 mode: PW/PW res: [0x20003c4f1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271499.253912:0:24474:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012f9033c0 already unused, calling callback (ffffffffa076c190) 00010000:00010000:0.0:1736271499.253914:0:24474:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9033c0/0xed4dbb87898d47af lrc: 2/0,0 mode: PW/PW res: [0x20003c4f1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271499.253920:0:24474:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9033c0/0xed4dbb87898d47af lrc: 3/0,0 mode: PW/PW res: [0x20003c4f1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271499.253928:0:24474:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003c4f1:0x1:0x0].0x0 (ffff88012e176b00) 00010000:00010000:0.0:1736271499.253930:0:24474:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1736271499.253931:0:27660:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900b40/0xed4dbb87898d479a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271499.253932:0:24474:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9033c0/0xed4dbb87898d47af lrc: 1/0,0 mode: --/PW res: [0x20003c4f1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253935:0:27660:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900b40/0xed4dbb87898d479a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271499.253937:0:24474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9033c0/0xed4dbb87898d47af lrc: 0/0,0 mode: --/PW res: [0x20003c4f1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134766852880 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253938:0:27660:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900b40/0xed4dbb87898d479a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253940:0:27660:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012f900b40 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:2.0:1736271499.253942:0:27660:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900b40/0xed4dbb87898d479a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253945:0:27660:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900b40/0xed4dbb87898d479a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271499.253946:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271499.253949:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880094cf0100) 00010000:00010000:2.0:1736271499.253950:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1736271499.253952:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271499.253953:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271499.253955:0:27660:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900b40/0xed4dbb87898d479a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.253958:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900b40/0xed4dbb87898d479a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1736271499.253962:0:27660:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff880131b16880 reply state ffff880131ad9000 transno 528280977411 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902400/0xed4dbb87898d47a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1736271499.253988:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b16880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+10:14281:x1820604058963264:12345-192.168.203.38@tcp:36:rm.0 Request processed in 420us (507us total) trans 528280977411 rc 0/0 00000100:00100000:2.0:1736271499.253992:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 829 00010000:00010000:2.0:1736271499.254527:0:3319:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902400/0xed4dbb87898d47a1 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.254534:0:3319:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1931768a (ffff8800acc62400) 00010000:00010000:2.0:1736271499.254536:0:3319:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736271499.254537:0:3319:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900900/0xed4dbb87898d47a8 lrc: 3/0,1 mode: COS/COS res: [0x20003c4f1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271499.254541:0:3319:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003c4f1:0x1:0x0].0x0 (ffff88012e176b00) 00010000:00010000:2.0:1736271499.254542:0:3319:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:1.0:1736271499.366441:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271499.366450:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271499.366456:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b117c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024051136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271499.366460:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c484c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024051072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271499.366507:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271499.366543:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271499.366545:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051072 00000100:00100000:0.0:1736271499.366568:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051136 00000100:00100000:2.0:1736271499.366590:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5754 00000100:00100000:0.0:1736271499.366594:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5755 00000100:00100000:2.0:1736271499.366595:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c485580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024051072:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271499.366598:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013715cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024051136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271499.366610:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8577856 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271499.366610:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271499.366640:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c485580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024051072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271499.366643:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013715cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024051136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271499.366645:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5754 00000100:00100000:0.0:1736271499.366656:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5755 00000100:00100000:1.0:1736271499.366665:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b117c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024051136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271499.366679:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c484c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024051072:0@lo:13:osp-pre-0-1.0 00000020:00000080:1.0:1736271499.505189:0:19427:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:1.0:1736271499.505197:0:19427:0:(class_obd.c:134:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:1.0:1736271499.505201:0:19427:0:(class_obd.c:141:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00010000:00010000:2.0:1736271500.176442:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271500.444366:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271500.444407:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271500.444425:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271500.444434:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058963328 00000100:00100000:3.0:1736271500.444449:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058963392 00000100:00100000:1.0:1736271500.444453:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271500.444469:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 162 00000100:00100000:2.0:1736271500.444473:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058963328:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271500.444473:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058963456 00000100:00100000:1.0:1736271500.444484:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271500.444487:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 619 00000100:00100000:3.0:1736271500.444490:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+10:1894:x1820604058963392:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271500.444501:0:21062:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058963520 00000100:00100000:1.0:1736271500.444505:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 620 00010000:00000080:3.0:1736271500.444505:0:27147:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880131b117c0 x1820604058963392/t0(0) o400->64bb3b11-afd7-4230-a38c-2a374f07ba02@192.168.203.38@tcp:271/0 lens 224/224 e 0 to 0 dl 1736271506 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:1.0:1736271500.444510:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1217c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058963456:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271500.444524:0:21062:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058963584 00000100:00100000:3.0:1736271500.444531:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+10:1894:x1820604058963392:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 40us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271500.444532:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058963328:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271500.444536:0:21062:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6948 00000100:00100000:1.0:1736271500.444536:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1217c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058963456:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 26us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271500.444536:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 619 00000100:00100000:2.0:1736271500.444538:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 162 00000100:00100000:0.0:1736271500.444540:0:21062:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1250c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1894:x1820604058963520:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271500.444542:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 620 00000100:00100000:3.0:1736271500.444552:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6949 00000100:00100000:3.0:1736271500.444555:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f124740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1895:x1820604058963584:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271500.444566:0:21062:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1250c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1894:x1820604058963520:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 25us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271500.444572:0:21062:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6948 00000100:00100000:3.0:1736271500.444572:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f124740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1895:x1820604058963584:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 16us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271500.444578:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6949 00000100:00100000:2.0:1736271500.470357:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736271500.470366:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736271500.470374:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024051200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1736271500.470375:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1820604024051264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1736271500.470431:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271500.470458:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051264 00000100:00100000:2.0:1736271500.470487:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5756 00000100:00100000:2.0:1736271500.470491:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a2f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1820604024051264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1736271500.470509:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8577856 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271500.470551:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a2f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1820604024051264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271500.470557:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5756 00000100:00100000:2.0:1736271500.470576:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271500.470588:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1820604024051264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1736271500.470593:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051200 00000100:00100000:2.0:1736271500.470618:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5757 00000100:00100000:2.0:1736271500.470621:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024051200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1736271500.470631:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271500.470654:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024051200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271500.470659:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5757 00000100:00100000:3.0:1736271500.470663:0:3336:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 85899347174 gen 2 00000004:00080000:3.0:1736271500.470667:0:3336:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff880131b10980, transno 85899347174 00000100:00100000:3.0:1736271500.470677:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024051200:0@lo:13:osp-pre-0-0.0 00000040:00100000:0.0:1736271500.470691:0:18279:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 2 in log [0x1ec:0x1:0x0] 00000100:00100000:3.0:1736271500.662481:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024051328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1736271500.662545:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271500.662597:0:9284:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051328 00000100:00100000:2.0:1736271500.662640:0:9284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112751 00000100:00100000:2.0:1736271500.662661:0:9284:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024051328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1736271500.662693:0:9284:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445720064 avail 1316257792 00000100:00100000:2.0:1736271500.662732:0:9284:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024051328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271500.662738:0:9284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112751 00000100:00100000:3.0:1736271500.662771:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024051328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1736271500.678412:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1820604024051456:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271500.678437:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024051392:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271500.678456:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ea140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1820604024051584:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736271500.678463:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271500.678470:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271500.678480:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271500.678492:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024051648:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736271500.678498:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024051712:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271500.678498:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aafd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024051840:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271500.678505:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271500.678514:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271500.678521:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aafda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024052096:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736271500.678522:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271500.678528:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aaf8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3333:1820604024051904:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271500.678532:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271500.678535:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aafc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1820604024051968:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271500.678541:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271500.678543:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1736271500.678546:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024051520:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736271500.678548:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051456 00000100:00100000:3.0:1736271500.678553:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1820604024052160:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736271500.678559:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271500.678559:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271500.678576:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051840 00000100:00100000:2.0:1736271500.678578:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024051776:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736271500.678587:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051584 00000100:00100000:2.0:1736271500.678588:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271500.678592:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051648 00000100:00100000:2.0:1736271500.678595:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aafe880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024052032:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736271500.678597:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051904 00000100:00100000:3.0:1736271500.678600:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052096 00000100:00100000:2.0:1736271500.678603:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271500.678607:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051520 00000100:00100000:3.0:1736271500.678609:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051776 00000100:00100000:0.0:1736271500.678610:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1736271500.678614:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c484c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1820604024051456:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271500.678617:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052032 00000100:00100000:1.0:1736271500.678621:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1736271500.678623:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051392 00000100:00100000:3.0:1736271500.678625:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6950 00000100:00100000:1.0:1736271500.678626:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1820604024051584:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271500.678628:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024051840:12345-0@lo:400:kworker/u8:0.0 00010000:00000080:0.0:1736271500.678631:0:27148:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009c484c00 x1820604024051456/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:271/0 lens 224/224 e 0 to 0 dl 1736271506 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:2.0:1736271500.678640:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1736271500.678642:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+23:3333:x1820604024051392:12345-0@lo:400:kworker/u8:0.0 00010000:00000080:1.0:1736271500.678645:0:27667:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800897c2140 x1820604024051584/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:271/0 lens 224/224 e 0 to 0 dl 1736271506 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:0.0:1736271500.678657:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c484c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1820604024051456:12345-0@lo:400:kworker/u8:0.0 Request processed in 44us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271500.678657:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024051840:12345-0@lo:400:kworker/u8:0.0 Request processed in 29us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271500.678662:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6950 00000100:00100000:0.0:1736271500.678663:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:2.0:1736271500.678663:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+23:3333:x1820604024051392:12345-0@lo:400:kworker/u8:0.0 Request processed in 20us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271500.678667:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1736271500.678672:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6951 00000100:00100000:0.0:1736271500.678673:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1736271500.678674:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024052096:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736271500.678675:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024051648:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271500.678694:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024052096:12345-0@lo:400:kworker/u8:0.0 Request processed in 19us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271500.678695:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1820604024051584:12345-0@lo:400:kworker/u8:0.0 Request processed in 69us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271500.678696:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024051648:12345-0@lo:400:kworker/u8:0.0 Request processed in 20us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271500.678697:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1736271500.678697:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6951 00000100:00100000:0.0:1736271500.678699:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1736271500.678700:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3333:x1820604024051904:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271500.678701:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6952 00000100:00100000:1.0:1736271500.678703:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1736271500.678703:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998de880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024051776:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736271500.678706:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00010000:00000080:2.0:1736271500.678707:0:27660:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008c8a3440 x1820604024051904/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:271/0 lens 224/224 e 0 to 0 dl 1736271506 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:0.0:1736271500.678708:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024051520:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271500.678713:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998de880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024051776:12345-0@lo:400:kworker/u8:0.0 Request processed in 10us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271500.678716:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6952 00000100:00100000:3.0:1736271500.678721:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6953 00000100:00100000:3.0:1736271500.678722:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998d9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024052032:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736271500.678723:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024051520:12345-0@lo:400:kworker/u8:0.0 Request processed in 14us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271500.678725:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3333:x1820604024051904:12345-0@lo:400:kworker/u8:0.0 Request processed in 25us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271500.678726:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1736271500.678728:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1736271500.678732:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998d9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3336:x1820604024052032:12345-0@lo:400:kworker/u8:0.0 Request processed in 9us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271500.678739:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6953 00000100:00100000:2.0:1736271500.678768:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024051520:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271500.678769:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051712 00000100:00100000:0.0:1736271500.678772:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1820604024051456:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271500.678774:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024051776:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271500.678779:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aafe880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024052032:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271500.678785:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ea140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1820604024051584:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271500.678788:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024051968 00000100:00100000:2.0:1736271500.678789:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aafd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024051840:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271500.678793:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aafda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1820604024052096:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736271500.678800:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112752 00000100:00100000:1.0:1736271500.678805:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c481c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024051712:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271500.678806:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112753 00000100:00100000:3.0:1736271500.678812:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c485f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3334:x1820604024051968:12345-0@lo:400:kworker/u8:0.0 00010000:00000080:1.0:1736271500.678818:0:27358:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009c481c80 x1820604024051712/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:271/0 lens 224/224 e 0 to 0 dl 1736271506 ref 1 fl Interpret:/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:3.0:1736271500.678834:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c485f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3334:x1820604024051968:12345-0@lo:400:kworker/u8:0.0 Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271500.678838:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112753 00000100:00100000:0.0:1736271500.678841:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aafc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1820604024051968:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736271500.678849:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c481c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024051712:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271500.678849:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271500.678855:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112752 00000100:00100000:0.0:1736271500.678856:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024051712:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271500.678860:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052160 00000100:00100000:3.0:1736271500.678862:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024051392:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271500.678868:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024051648:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271500.678873:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:3.0:1736271500.678873:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aaf8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3333:1820604024051904:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271500.678875:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1820604024052160:12345-0@lo:400:kworker/u8:0.0 00010000:00000080:2.0:1736271500.678881:0:27147:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008c8a17c0 x1820604024052160/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:271/0 lens 224/224 e 0 to 0 dl 1736271506 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:2.0:1736271500.678897:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1820604024052160:12345-0@lo:400:kworker/u8:0.0 Request processed in 22us (50us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271500.678900:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:3.0:1736271500.678906:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1820604024052160:0@lo:400:kworker/u8:0.0 00000400:00000080:3.0:1736271500.975343:0:19820:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1736271500.975346:0:19820:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1736271500.995300:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271500.995337:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058963648 00000100:00100000:2.0:1736271500.995367:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 830 00000100:00100000:2.0:1736271500.995374:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c483900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+10:14354:x1820604058963648:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1736271500.995387:0:27660:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1736271500.995399:0:27660:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f901d40/0xed4dbb87898d47b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252fa6fdbb94bcb9 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995439:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903180/0xed4dbb87898d47bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995450:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903180/0xed4dbb87898d47bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995461:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903180/0xed4dbb87898d47bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995473:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903cc0/0xed4dbb87898d47c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995478:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903cc0/0xed4dbb87898d47c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995483:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903cc0/0xed4dbb87898d47c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995523:0:27660:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903180/0xed4dbb87898d47bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995528:0:27660:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903180/0xed4dbb87898d47bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995533:0:27660:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903180/0xed4dbb87898d47bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995543:0:27660:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012f903180 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:2.0:1736271500.995546:0:27660:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903180/0xed4dbb87898d47bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995552:0:27660:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903180/0xed4dbb87898d47bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995561:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880094cf0100) 00010000:00010000:2.0:1736271500.995564:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736271500.995566:0:27660:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903180/0xed4dbb87898d47bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995570:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903180/0xed4dbb87898d47bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995578:0:27660:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903cc0/0xed4dbb87898d47c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995582:0:27660:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903cc0/0xed4dbb87898d47c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995587:0:27660:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903cc0/0xed4dbb87898d47c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995591:0:27660:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012f903cc0 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:2.0:1736271500.995592:0:27660:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903cc0/0xed4dbb87898d47c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995596:0:27660:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903cc0/0xed4dbb87898d47c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995606:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7fda96f6 (ffff8800a3c6a000) 00010000:00010000:2.0:1736271500.995608:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736271500.995610:0:27660:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903cc0/0xed4dbb87898d47c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995613:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f903cc0/0xed4dbb87898d47c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995636:0:27660:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f901d40/0xed4dbb87898d47b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcb9 expref: 11 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995642:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f901d40/0xed4dbb87898d47b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcb9 expref: 11 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.995648:0:27660:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012f901d40, rc 0) 00010000:00000080:2.0:1736271500.995652:0:27660:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009c483900 x1820604058963648/t0(0) o101->64bb3b11-afd7-4230-a38c-2a374f07ba02@192.168.203.38@tcp:271/0 lens 592/640 e 0 to 0 dl 1736271506 ref 1 fl Interpret:/0/0 rc 301/0 job:'lfs.0' 00000100:00100000:2.0:1736271500.995709:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c483900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+10:14354:x1820604058963648:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 332us (411us total) trans 0 rc 301/301 00000100:00100000:2.0:1736271500.995715:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 830 00000100:00100000:2.0:1736271500.996824:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271500.996918:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058963776 00000100:00100000:3.0:1736271500.996967:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 831 00000100:00100000:3.0:1736271500.996971:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998df200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+10:14354:x1820604058963776:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1736271500.996985:0:27660:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1736271500.996997:0:27660:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9998c0/0xed4dbb87898d47cb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252fa6fdbb94bcc0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997074:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a999b00/0xed4dbb87898d47d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997094:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a999b00/0xed4dbb87898d47d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997102:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a999b00/0xed4dbb87898d47d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997111:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998d80/0xed4dbb87898d47d9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997114:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998d80/0xed4dbb87898d47d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997117:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998d80/0xed4dbb87898d47d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997463:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998b40/0xed4dbb87898d47e0 lrc: 3/1,0 mode: --/CR res: [0x20003c4f1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997468:0:27660:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998b40/0xed4dbb87898d47e0 lrc: 3/1,0 mode: CR/CR res: [0x20003c4f1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997472:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998b40/0xed4dbb87898d47e0 lrc: 3/1,0 mode: CR/CR res: [0x20003c4f1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1736271500.997478:0:27660:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20003c4f1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1736271500.997493:0:27660:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a999b00/0xed4dbb87898d47d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997496:0:27660:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a999b00/0xed4dbb87898d47d2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997507:0:27660:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a999b00/0xed4dbb87898d47d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997510:0:27660:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a999b00 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:3.0:1736271500.997512:0:27660:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a999b00/0xed4dbb87898d47d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997515:0:27660:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a999b00/0xed4dbb87898d47d2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997524:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880094cf0100) 00010000:00010000:3.0:1736271500.997526:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1736271500.997528:0:27660:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a999b00/0xed4dbb87898d47d2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997533:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a999b00/0xed4dbb87898d47d2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1736271500.997543:0:27660:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800998df200 reply state ffff88012d064000 transno 528280977412 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998d80/0xed4dbb87898d47d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997564:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9998c0/0xed4dbb87898d47cb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcc0 expref: 13 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997575:0:27660:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998b40/0xed4dbb87898d47e0 lrc: 3/0,0 mode: CR/CR res: [0x20003c4f1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcc0 expref: 12 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.997581:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003c4f1:0x2:0x0].0x0 (ffff88012b370400) 00010000:00010000:3.0:1736271500.997587:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1736271500.997589:0:27660:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a998b40, rc 0) 00010000:00000080:3.0:1736271500.997594:0:27660:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800998df200 x1820604058963776/t528280977412(0) o101->64bb3b11-afd7-4230-a38c-2a374f07ba02@192.168.203.38@tcp:271/0 lens 536/600 e 0 to 0 dl 1736271506 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:3.0:1736271500.997658:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998df200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+13:14354:x1820604058963776:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 685us (835us total) trans 528280977412 rc 0/0 00000100:00100000:3.0:1736271500.997665:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 831 00010000:00010000:2.0:1736271500.998279:0:3320:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998d80/0xed4dbb87898d47d9 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271500.998290:0:3320:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7fda96f6 (ffff88012b370100) 00010000:00010000:2.0:1736271500.998292:0:3320:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1736271500.998607:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271500.998672:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058963904 00000100:00100000:3.0:1736271500.998708:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 832 00000100:00100000:3.0:1736271500.998712:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c484740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+13:14354:x1820604058963904:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1736271500.998722:0:27660:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1736271500.998728:0:27660:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a999f80/0xed4dbb87898d47ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252fa6fdbb94bcc7 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.998772:0:27660:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 3/0,1 mode: --/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.998778:0:27660:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998b40/0xed4dbb87898d47e0 lrc: 2/0,0 mode: CR/CR res: [0x20003c4f1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcc0 expref: 14 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.998783:0:27660:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 4/0,1 mode: --/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.998809:0:27660:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998b40/0xed4dbb87898d47e0 lrc: 3/0,0 mode: CR/CR res: [0x20003c4f1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcc0 expref: 14 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.998817:0:27660:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998b40/0xed4dbb87898d47e0 lrc: 4/0,0 mode: CR/CR res: [0x20003c4f1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcc0 expref: 14 pid: 27660 timeout: 8386 lvb_type: 0 00000100:00100000:3.0:1736271500.998834:0:27660:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a4c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:27660:1820604024052224:192.168.203.38@tcp:104: 00000100:00100000:3.0:1736271500.998876:0:27660:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800935bb780 going to sleep for 11 seconds 00000100:00100000:3.0:1736271500.999438:0:27660:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a4c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:27660:1820604024052224:192.168.203.38@tcp:104: 00010000:00010000:3.0:1736271500.999454:0:27660:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 3/0,1 mode: --/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1736271500.999626:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271500.999674:0:16574:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058963968 00010000:00010000:1.0:1736271500.999691:0:16574:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998b40/0xed4dbb87898d47e0 lrc: 4/0,0 mode: CR/CR res: [0x20003c4f1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcc0 expref: 15 pid: 27660 timeout: 8386 lvb_type: 0 00000100:00100000:1.0:1736271500.999722:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 94862 00000100:00100000:1.0:1736271500.999726:0:16574:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c481300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+15:1893:x1820604058963968:12345-192.168.203.38@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1736271500.999735:0:16574:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1736271500.999739:0:16574:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998b40/0xed4dbb87898d47e0 lrc: 4/0,0 mode: CR/CR res: [0x20003c4f1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcc0 expref: 15 pid: 27660 timeout: 8386 lvb_type: 0 00010000:00010000:1.0:1736271500.999770:0:16574:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998b40/0xed4dbb87898d47e0 lrc: 3/0,0 mode: CR/CR res: [0x20003c4f1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcc0 expref: 15 pid: 27660 timeout: 8386 lvb_type: 0 00010000:00010000:1.0:1736271500.999783:0:16574:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998b40/0xed4dbb87898d47e0 lrc: 0/0,0 mode: --/CR res: [0x20003c4f1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcc0 expref: 15 pid: 27660 timeout: 8386 lvb_type: 0 00010000:00010000:1.0:1736271500.999793:0:16574:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003c4f1:0x2:0x0].0x0 (ffff88012b370400) 00010000:00010000:1.0:1736271500.999796:0:16574:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 3/0,1 mode: --/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271500.999803:0:16574:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 3/0,1 mode: EX/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271500.999808:0:16574:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 4/0,1 mode: EX/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271500.999832:0:16574:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1736271500.999856:0:27660:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 3/0,1 mode: EX/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1736271500.999863:0:16574:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c481300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+14:1893:x1820604058963968:12345-192.168.203.38@tcp:103:ldlm_bl_02.0 Request processed in 136us (237us total) trans 0 rc 0/0 00010000:00010000:3.0:1736271500.999864:0:27660:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 3/0,1 mode: EX/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1736271500.999870:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 94862 00000004:00200000:3.0:1736271500.999874:0:27660:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20003c4f1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1736271500.999962:0:27660:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 3/0,1 mode: EX/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.999968:0:27660:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 2/0,0 mode: EX/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.999973:0:27660:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 3/0,0 mode: EX/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.999977:0:27660:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a99aac0 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:3.0:1736271500.999979:0:27660:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 3/0,0 mode: EX/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.999984:0:27660:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 4/0,0 mode: EX/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271500.999996:0:27660:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003c4f1:0x2:0x0].0x0 (ffff88012b370400) 00010000:00010000:3.0:1736271500.999998:0:27660:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1736271501.000000:0:27660:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 2/0,0 mode: --/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.000004:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99aac0/0xed4dbb87898d47f5 lrc: 0/0,0 mode: --/EX res: [0x20003c4f1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.000029:0:27660:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a999f80/0xed4dbb87898d47ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcc7 expref: 14 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.000034:0:27660:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a999f80/0xed4dbb87898d47ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcc7 expref: 14 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.000041:0:27660:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a999f80, rc 0) 00010000:00000080:3.0:1736271501.000045:0:27660:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009c484740 x1820604058963904/t528280977413(0) o101->64bb3b11-afd7-4230-a38c-2a374f07ba02@192.168.203.38@tcp:271/0 lens 712/816 e 0 to 0 dl 1736271506 ref 1 fl Interpret:/0/0 rc 301/0 job:'lfs.0' 00000100:00100000:3.0:1736271501.000084:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c484740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+13:14354:x1820604058963904:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1371us (1478us total) trans 528280977413 rc 301/301 00000100:00100000:3.0:1736271501.000091:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 832 00000100:00100000:0.0:1736271501.000852:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271501.000903:0:1216:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058964096 00000100:00100000:2.0:1736271501.000938:0:1216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:2.0:1736271501.000941:0:1216:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+13:14354:x1820604058964096:12345-192.168.203.38@tcp:35:lfs.0 00010000:00000080:2.0:1736271501.001042:0:1216:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800934e84c0 x1820604058964096/t528280977414(0) o35->64bb3b11-afd7-4230-a38c-2a374f07ba02@192.168.203.38@tcp:272/0 lens 392/456 e 0 to 0 dl 1736271507 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:2.0:1736271501.001080:0:1216:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+14:14354:x1820604058964096:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 137us (228us total) trans 528280977414 rc 0/0 00000100:00100000:2.0:1736271501.001087:0:1216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:0.0:1736271501.001818:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271501.001856:0:1216:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058964224 00000100:00100000:2.0:1736271501.001879:0:1216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:2.0:1736271501.001881:0:1216:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008992d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+14:14354:x1820604058964224:12345-192.168.203.38@tcp:35:lfs.0 00010000:00000080:2.0:1736271501.001925:0:1216:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008992d850 x1820604058964224/t528280977415(0) o35->64bb3b11-afd7-4230-a38c-2a374f07ba02@192.168.203.38@tcp:272/0 lens 392/456 e 0 to 0 dl 1736271507 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:2.0:1736271501.001951:0:1216:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008992d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+15:14354:x1820604058964224:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 69us (135us total) trans 528280977415 rc 0/0 00000100:00100000:2.0:1736271501.001955:0:1216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 108 00010000:00010000:0.0:1736271501.178321:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271501.398415:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736271501.398434:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800998d97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024052288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1736271501.398485:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271501.398518:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052288 00000100:00100000:1.0:1736271501.398565:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112754 00000100:00100000:1.0:1736271501.398571:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024052288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1736271501.398600:0:27358:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445253120 avail 1315790848 00010000:00000080:1.0:1736271501.398615:0:27358:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008c8a4c00 x1820604024052288/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:272/0 lens 224/368 e 0 to 0 dl 1736271507 ref 1 fl Interpret:/0/0 rc 0/0 job:'osp-pre-0-1.0' 00000100:00100000:1.0:1736271501.398654:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024052288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271501.398665:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112754 00000100:00100000:2.0:1736271501.399358:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800998d97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024052288:0@lo:41:osp-pre-0-1.0 00000020:01000004:3.0:1736271501.506975:0:19949:0:(obd_mount_server.c:1591:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1736271501.506991:0:19949:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff88009a998000/0xed4dbb87898d440c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xed4dbb87898d4413 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.507013:0:19949:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff88009a998000/0xed4dbb87898d440c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xed4dbb87898d4413 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.507018:0:19949:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff88009a998000/0xed4dbb87898d440c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xed4dbb87898d4413 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.507023:0:19949:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff88009a998000/0xed4dbb87898d440c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xed4dbb87898d4413 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.507047:0:19949:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1736271501.507052:0:19949:0:(mgc_request.c:544:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1736271501.507061:0:19949:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1736271501.507065:0:19949:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1736271501.507072:0:19949:0:(pinger.c:414:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1736271501.507090:0:19949:0:(import.c:86:import_set_state_nolock()) ffff88009c9f6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1736271501.507107:0:19949:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c50c0 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-lwp-MDT0000_UUID:19949:1820604024052352:0@lo:39:umount.0 00010000:00010000:0.0:1736271501.507119:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1736271501.507128:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff88009a998000/0xed4dbb87898d440c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xed4dbb87898d4413 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.507138:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a998000 already unused, calling callback (ffffffffa0aec5c0) 10000000:00010000:0.0:1736271501.507140:0:6841:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff88009a998000/0xed4dbb87898d440c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xed4dbb87898d4413 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.507146:0:6841:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff88009a998000/0xed4dbb87898d440c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xed4dbb87898d4413 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1736271501.507150:0:6841:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff88009a998000/0xed4dbb87898d440c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xed4dbb87898d4413 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1736271501.507153:0:6841:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1736271501.507155:0:6841:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1736271501.507157:0:6841:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1736271501.507163:0:19949:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1736271501.507188:0:6841:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.138@tcp lock: ffff88009a998000/0xed4dbb87898d440c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4413 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1736271501.507188:0:19949:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800935bb900 going to sleep for 5 seconds 00010000:00010000:0.0:1736271501.507192:0:6841:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1736271501.507209:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052352 00010000:00010000:0.0:1736271501.507225:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff88009a998000/0xed4dbb87898d440c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4413 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.507229:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff88009a998000/0xed4dbb87898d440c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4413 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1736271501.507237:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:2.0:1736271501.507240:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf58e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:19949:x1820604024052352:12345-0@lo:39:umount.0 00010000:00010000:0.0:1736271501.507243:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271501.507248:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024052416:0@lo:103:ldlm_bl_02.0 00010000:00010000:0.0:1736271501.507252:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271501.507253:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1736271501.507283:0:27660:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xed4dbb87898d452b 00000100:00080000:2.0:1736271501.507289:0:27660:0:(import.c:86:import_set_state_nolock()) ffff88009c9f2000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000100:00100000:1.0:1736271501.507300:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1736271501.507303:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271501.507362:0:16574:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052416 00010000:00000080:2.0:1736271501.507366:0:27660:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012bf58e40 x1820604024052352/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:272/0 lens 224/224 e 0 to 0 dl 1736271507 ref 1 fl Interpret:/0/0 rc 0/0 job:'umount.0' 00000100:00100000:2.0:1736271501.507402:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf58e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:19949:x1820604024052352:12345-0@lo:39:umount.0 Request processed in 161us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271501.507405:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27190 00000100:00100000:0.0:1736271501.507409:0:16574:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da43bf2a-6599-41e6-baa1-4103623ce0d4+23:3335:x1820604024052416:12345-0@lo:103:ldlm_bl_02.0 00000100:00100000:2.0:1736271501.507412:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00010000:00010000:0.0:1736271501.507418:0:16574:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:2.0:1736271501.507419:0:27660:0:(genops.c:985:class_export_put()) final put ffff88009c9f0800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1736271501.507430:0:16574:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c97fcc0/0xed4dbb87898d4413 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xed4dbb87898d440c expref: 23 pid: 18267 timeout: 0 lvb_type: 0 00000020:00000080:2.0:1736271501.507436:0:29989:0:(genops.c:944:class_export_destroy()) destroying export ffff88009c9f0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1736271501.507439:0:16574:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1736271501.507452:0:19949:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c50c0 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-lwp-MDT0000_UUID:19949:1820604024052352:0@lo:39:umount.0 00000100:00080000:3.0:1736271501.507463:0:19949:0:(import.c:86:import_set_state_nolock()) ffff88009c9f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1736271501.507466:0:19949:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1736271501.507468:0:19949:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1736271501.507470:0:19949:0:(import.c:339:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1736271501.507483:0:29989:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88009c9f2000 for lustre-MDT0000 00000100:00100000:0.0:1736271501.507492:0:16574:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da43bf2a-6599-41e6-baa1-4103623ce0d4+22:3335:x1820604024052416:12345-0@lo:103:ldlm_bl_02.0 Request processed in 83us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271501.507496:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27190 00000100:00100000:1.0:1736271501.507525:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024052416:0@lo:103:ldlm_bl_02.0 00010000:00010000:3.0:1736271501.508392:0:19949:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff88009d1e1200/0xed4dbb87898d433a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xed4dbb87898d4341 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.508400:0:19949:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff88009d1e1200/0xed4dbb87898d433a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xed4dbb87898d4341 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.508410:0:19949:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff88009d1e1200/0xed4dbb87898d433a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xed4dbb87898d4341 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.508415:0:19949:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff88009d1e1200/0xed4dbb87898d433a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xed4dbb87898d4341 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.508426:0:19949:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736271501.508430:0:19949:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff88012f901680/0xed4dbb87898d442f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xed4dbb87898d4436 expref: -99 pid: 6849 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.508435:0:19949:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff88012f901680/0xed4dbb87898d442f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xed4dbb87898d4436 expref: -99 pid: 6849 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271501.508436:0:24474:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736271501.508440:0:19949:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff88012f901680/0xed4dbb87898d442f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xed4dbb87898d4436 expref: -99 pid: 6849 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271501.508441:0:24474:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff88009d1e1200/0xed4dbb87898d433a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xed4dbb87898d4341 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.508445:0:19949:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff88012f901680/0xed4dbb87898d442f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xed4dbb87898d4436 expref: -99 pid: 6849 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271501.508448:0:24474:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e1200 already unused, calling callback (ffffffffa0aec5c0) 10000000:00010000:2.0:1736271501.508450:0:24474:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff88009d1e1200/0xed4dbb87898d433a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xed4dbb87898d4341 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.508455:0:19949:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271501.508456:0:24474:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff88009d1e1200/0xed4dbb87898d433a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xed4dbb87898d4341 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.508459:0:19949:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff88012f902ac0/0xed4dbb87898d43fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xed4dbb87898d4405 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1736271501.508461:0:24474:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff88009d1e1200/0xed4dbb87898d433a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xed4dbb87898d4341 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.508463:0:19949:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff88012f902ac0/0xed4dbb87898d43fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xed4dbb87898d4405 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1736271501.508465:0:24474:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1736271501.508467:0:6840:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1736271501.508467:0:24474:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1736271501.508468:0:19949:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff88012f902ac0/0xed4dbb87898d43fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xed4dbb87898d4405 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271501.508471:0:6840:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff88012f901680/0xed4dbb87898d442f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xed4dbb87898d4436 expref: -99 pid: 6849 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.508473:0:19949:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff88012f902ac0/0xed4dbb87898d43fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xed4dbb87898d4405 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271501.508477:0:6840:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012f901680 already unused, calling callback (ffffffffa0aec5c0) 10000000:00010000:1.0:1736271501.508479:0:6840:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff88012f901680/0xed4dbb87898d442f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xed4dbb87898d4436 expref: -99 pid: 6849 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271501.508482:0:24474:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.138@tcp lock: ffff88009d1e1200/0xed4dbb87898d433a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4341 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271501.508485:0:6840:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff88012f901680/0xed4dbb87898d442f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xed4dbb87898d4436 expref: -99 pid: 6849 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.508486:0:19949:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1736271501.508487:0:24474:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1736271501.508490:0:6840:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff88012f901680/0xed4dbb87898d442f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xed4dbb87898d4436 expref: -99 pid: 6849 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.508490:0:19949:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff88009d1e0fc0/0xed4dbb87898d432c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xed4dbb87898d4333 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.508493:0:9292:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1736271501.508494:0:6840:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1736271501.508494:0:19949:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff88009d1e0fc0/0xed4dbb87898d432c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xed4dbb87898d4333 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.508496:0:9292:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff88012f902ac0/0xed4dbb87898d43fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xed4dbb87898d4405 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1736271501.508496:0:6840:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1736271501.508497:0:6840:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1736271501.508501:0:19949:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff88009d1e0fc0/0xed4dbb87898d432c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xed4dbb87898d4333 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.508502:0:9292:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012f902ac0 already unused, calling callback (ffffffffa0aec5c0) 10000000:00010000:0.0:1736271501.508503:0:9292:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff88012f902ac0/0xed4dbb87898d43fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xed4dbb87898d4405 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271501.508504:0:24474:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff88009d1e1200/0xed4dbb87898d433a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4341 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736271501.508505:0:19949:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff88009d1e0fc0/0xed4dbb87898d432c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xed4dbb87898d4333 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.508508:0:9292:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff88012f902ac0/0xed4dbb87898d43fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xed4dbb87898d4405 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271501.508510:0:6840:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.138@tcp lock: ffff88012f901680/0xed4dbb87898d442f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4436 expref: -99 pid: 6849 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271501.508510:0:24474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff88009d1e1200/0xed4dbb87898d433a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4341 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1736271501.508513:0:9292:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff88012f902ac0/0xed4dbb87898d43fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xed4dbb87898d4405 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271501.508514:0:6840:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1736271501.508517:0:9292:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1736271501.508517:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800998d97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024052480:0@lo:103:ldlm_bl_05.0 00010000:00010000:2.0:1736271501.508518:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1736271501.508519:0:9292:0:(mgc_request.c:1044:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1736271501.508520:0:9292:0:(mgc_request.c:153:config_log_put()) dropping config log params 00010000:00010000:1.0:1736271501.508524:0:6840:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff88012f901680/0xed4dbb87898d442f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4436 expref: -99 pid: 6849 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271501.508524:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271501.508525:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271501.508529:0:6840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff88012f901680/0xed4dbb87898d442f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4436 expref: -99 pid: 6849 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.508530:0:9292:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.138@tcp lock: ffff88012f902ac0/0xed4dbb87898d43fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4405 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1736271501.508534:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024052544:0@lo:103:ldlm_bl_01.0 00000100:00100000:3.0:1736271501.508538:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1736271501.508539:0:9292:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1736271501.508543:0:9292:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff88012f902ac0/0xed4dbb87898d43fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4405 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271501.508545:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271501.508546:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271501.508547:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271501.508548:0:9292:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff88012f902ac0/0xed4dbb87898d43fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4405 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1736271501.508557:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1736271501.508558:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271501.508558:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271501.508559:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271501.508563:0:19949:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1736271501.508567:0:6841:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1736271501.508567:0:19949:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1736271501.508569:0:6841:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff88009d1e0fc0/0xed4dbb87898d432c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xed4dbb87898d4333 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1736271501.508569:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 10000000:01000000:3.0:1736271501.508570:0:19949:0:(mgc_request.c:544:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:2.0:1736271501.508573:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024052608:0@lo:103:ldlm_bl_04.0 00010000:00010000:0.0:1736271501.508574:0:6841:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d1e0fc0 already unused, calling callback (ffffffffa0aec5c0) 10000000:00010000:0.0:1736271501.508576:0:6841:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff88009d1e0fc0/0xed4dbb87898d432c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xed4dbb87898d4333 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00000020:01000004:3.0:1736271501.508576:0:19949:0:(obd_mount_server.c:1629:server_put_super()) stopping lustre-MDT0000 00000100:00100000:1.0:1736271501.508578:0:16574:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052480 00000020:01000000:3.0:1736271501.508579:0:19949:0:(obd_config.c:2324:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:0.0:1736271501.508581:0:6841:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff88009d1e0fc0/0xed4dbb87898d432c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xed4dbb87898d4333 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00000020:00000080:3.0:1736271501.508582:0:19949:0:(obd_config.c:1384:class_process_config()) processing cmd: cf004 10000000:00010000:0.0:1736271501.508585:0:6841:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff88009d1e0fc0/0xed4dbb87898d432c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xed4dbb87898d4333 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00000020:02000400:3.0:1736271501.508585:0:19949:0:(obd_config.c:854:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:2.0:1736271501.508587:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:3.0:1736271501.508588:0:19949:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x40086672 10000000:01000000:0.0:1736271501.508589:0:6841:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1736271501.508591:0:6841:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1736271501.508592:0:6841:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1736271501.508600:0:6841:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.138@tcp lock: ffff88009d1e0fc0/0xed4dbb87898d432c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4333 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.508605:0:6841:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1736271501.508610:0:16574:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052544 00000100:00100000:3.0:1736271501.508612:0:6839:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052608 00010000:00010000:0.0:1736271501.508617:0:6841:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff88009d1e0fc0/0xed4dbb87898d432c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4333 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.508622:0:6841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff88009d1e0fc0/0xed4dbb87898d432c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xed4dbb87898d4333 expref: -99 pid: 18261 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1736271501.508626:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27191 00000100:00100000:1.0:1736271501.508630:0:16574:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da43bf2a-6599-41e6-baa1-4103623ce0d4+24:3336:x1820604024052480:12345-0@lo:103:ldlm_bl_05.0 00010000:00010000:0.0:1736271501.508631:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736271501.508632:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271501.508632:0:6839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27192 00010000:00010000:0.0:1736271501.508633:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271501.508635:0:6839:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998dda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da43bf2a-6599-41e6-baa1-4103623ce0d4+24:3333:x1820604024052544:12345-0@lo:103:ldlm_bl_01.0 00010000:00010000:1.0:1736271501.508638:0:16574:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1736271501.508642:0:6839:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1736271501.508644:0:7393:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27193 00010000:00010000:1.0:1736271501.508646:0:16574:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012f903840/0xed4dbb87898d4341 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xed4dbb87898d433a expref: 24 pid: 18267 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1736271501.508647:0:7393:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998dd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:da43bf2a-6599-41e6-baa1-4103623ce0d4+24:3333:x1820604024052608:12345-0@lo:103:ldlm_bl_04.0 00010000:00010000:3.0:1736271501.508649:0:6839:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c97e880/0xed4dbb87898d4436 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xed4dbb87898d442f expref: 24 pid: 18267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.508653:0:7393:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1736271501.508655:0:16574:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1736271501.508658:0:7393:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009d1e18c0/0xed4dbb87898d4405 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xed4dbb87898d43fe expref: 23 pid: 18267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.508663:0:7393:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1736271501.508666:0:6839:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1736271501.508674:0:16574:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da43bf2a-6599-41e6-baa1-4103623ce0d4+21:3336:x1820604024052480:12345-0@lo:103:ldlm_bl_05.0 Request processed in 43us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271501.508679:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27191 00000100:00100000:0.0:1736271501.508694:0:7393:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998dd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:da43bf2a-6599-41e6-baa1-4103623ce0d4+20:3333:x1820604024052608:12345-0@lo:103:ldlm_bl_04.0 Request processed in 46us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271501.508695:0:6839:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998dda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da43bf2a-6599-41e6-baa1-4103623ce0d4+20:3333:x1820604024052544:12345-0@lo:103:ldlm_bl_01.0 Request processed in 59us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271501.508699:0:7393:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27193 00000100:00100000:3.0:1736271501.508702:0:6839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27192 00000100:00100000:0.0:1736271501.508712:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ea140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024052672:0@lo:103:ldlm_bl_02.0 00000100:00100000:2.0:1736271501.508717:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024052608:0@lo:103:ldlm_bl_04.0 00000100:00100000:3.0:1736271501.508725:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800998d97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024052480:0@lo:103:ldlm_bl_05.0 00000100:00100000:2.0:1736271501.508726:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024052544:0@lo:103:ldlm_bl_01.0 00000100:00100000:0.0:1736271501.508731:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271501.508762:0:6839:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052672 00000100:00100000:1.0:1736271501.508779:0:6839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27194 00000100:00100000:1.0:1736271501.508782:0:6839:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934eb900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da43bf2a-6599-41e6-baa1-4103623ce0d4+19:3335:x1820604024052672:12345-0@lo:103:ldlm_bl_02.0 00010000:00010000:1.0:1736271501.508792:0:6839:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1736271501.508799:0:6839:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012f9018c0/0xed4dbb87898d4333 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xed4dbb87898d432c expref: 19 pid: 18267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736271501.508805:0:6839:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1736271501.508823:0:6839:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934eb900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024052672:12345-0@lo:103:ldlm_bl_02.0 Request processed in 40us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271501.508828:0:6839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27194 00000100:00100000:2.0:1736271501.508839:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ea140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024052672:0@lo:103:ldlm_bl_02.0 00000001:00080000:2.0:1736271501.509015:0:18263:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 528280977415 is committed 00010000:00010000:0.0:1736271501.509034:0:3319:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99a880/0xed4dbb87898d4769 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509039:0:3319:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99a880/0xed4dbb87898d4769 lrc: 2/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509042:0:3319:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99a880/0xed4dbb87898d4769 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509052:0:3319:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a99a880 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:0.0:1736271501.509054:0:3319:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99a880/0xed4dbb87898d4769 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509058:0:3319:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99a880/0xed4dbb87898d4769 lrc: 4/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509065:0:3319:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1931768a (ffff8800acc62400) 00010000:00010000:0.0:1736271501.509066:0:3319:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1736271501.509068:0:3319:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99a880/0xed4dbb87898d4769 lrc: 2/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509070:0:3319:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a99a880/0xed4dbb87898d4769 lrc: 0/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509079:0:3319:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902400/0xed4dbb87898d47a1 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000020:00000080:3.0:1736271501.509079:0:19949:0:(obd_config.c:877:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/12 00010000:00010000:0.0:1736271501.509083:0:3319:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902400/0xed4dbb87898d47a1 lrc: 2/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1736271501.509085:0:19949:0:(genops.c:1752:print_export_data()) lustre-MDT0000: ACTIVE ffff88009be2c800 64bb3b11-afd7-4230-a38c-2a374f07ba02 192.168.203.38@tcp 7 (0 0 1) 0 0 0 1: ffff88012d064000 528280977415 stale:0 00010000:00010000:0.0:1736271501.509086:0:3319:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902400/0xed4dbb87898d47a1 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509088:0:3319:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012f902400 already unused, calling callback (ffffffffa0eab360) 00010000:00010000:0.0:1736271501.509089:0:3319:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902400/0xed4dbb87898d47a1 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1736271501.509091:0:19949:0:(genops.c:1752:print_export_data()) lustre-MDT0000: ACTIVE ffff880075c9c000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: (null) 0 stale:0 00010000:00010000:0.0:1736271501.509092:0:3319:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902400/0xed4dbb87898d47a1 lrc: 4/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1736271501.509096:0:19949:0:(genops.c:1752:print_export_data()) lustre-MDT0000: ACTIVE ffff88008f18b000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: (null) 0 stale:0 00010000:00010000:0.0:1736271501.509099:0:3319:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1931768a (ffff8800acc62400) 00000020:00080000:3.0:1736271501.509099:0:19949:0:(genops.c:1752:print_export_data()) lustre-MDT0000: ACTIVE ffff88008f18d800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: (null) 0 stale:0 00010000:00010000:0.0:1736271501.509100:0:3319:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1736271501.509101:0:3319:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902400/0xed4dbb87898d47a1 lrc: 2/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1736271501.509103:0:19949:0:(genops.c:1752:print_export_data()) lustre-MDT0000: ACTIVE ffff88008faa9000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: (null) 0 stale:0 00010000:00010000:0.0:1736271501.509104:0:3319:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f902400/0xed4dbb87898d47a1 lrc: 0/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x1931768a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1736271501.509107:0:19949:0:(genops.c:1752:print_export_data()) lustre-MDT0000: UNLINKED ffff88008faa8000 64bb3b11-afd7-4230-a38c-2a374f07ba02 192.168.203.38@tcp 1 (0 0 0) 1 0 1 0: (null) 523986010115 stale:0 00000020:00080000:3.0:1736271501.509111:0:19949:0:(genops.c:1525:class_disconnect_exports()) OBD device 5 (ffff88012c7ad0c0) has exports, disconnecting them 00010000:00010000:0.0:1736271501.509112:0:3319:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900900/0xed4dbb87898d47a8 lrc: 3/0,1 mode: COS/COS res: [0x20003c4f1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509114:0:3319:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900900/0xed4dbb87898d47a8 lrc: 2/0,0 mode: COS/COS res: [0x20003c4f1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1736271501.509114:0:19949:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.38@tcp (ffff88009be2c800), last request at 1736271501 00010000:00010000:0.0:1736271501.509117:0:3319:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900900/0xed4dbb87898d47a8 lrc: 3/0,0 mode: COS/COS res: [0x20003c4f1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000020:00000080:3.0:1736271501.509117:0:19949:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xed4dbb87898d46f9 00010000:00010000:0.0:1736271501.509119:0:3319:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012f900900 already unused, calling callback (ffffffffa0eab360) 00000020:00010000:3.0:1736271501.509120:0:19949:0:(genops.c:1857:obd_stale_export_put()) Put export ffff88009be2c800: total 2 00010000:00010000:0.0:1736271501.509121:0:3319:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900900/0xed4dbb87898d47a8 lrc: 3/0,0 mode: COS/COS res: [0x20003c4f1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1736271501.509123:0:19949:0:(import.c:86:import_set_state_nolock()) ffff88009be2f800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:0.0:1736271501.509124:0:3319:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900900/0xed4dbb87898d47a8 lrc: 4/0,0 mode: COS/COS res: [0x20003c4f1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509127:0:3319:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003c4f1:0x1:0x0].0x0 (ffff88012e176b00) 00010000:00010000:0.0:1736271501.509128:0:3319:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1736271501.509129:0:3319:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900900/0xed4dbb87898d47a8 lrc: 2/0,0 mode: --/COS res: [0x20003c4f1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509136:0:3319:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f900900/0xed4dbb87898d47a8 lrc: 0/0,0 mode: --/COS res: [0x20003c4f1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000020:00010000:2.0:1736271501.509137:0:9291:0:(genops.c:1843:obd_stale_export_get()) Get export ffff88009be2c800: total 2 00010000:00010000:0.0:1736271501.509144:0:3319:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998d80/0xed4dbb87898d47d9 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509147:0:3319:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998d80/0xed4dbb87898d47d9 lrc: 2/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509150:0:3319:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998d80/0xed4dbb87898d47d9 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509153:0:3319:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a998d80 already unused, calling callback (ffffffffa0eab360) 00000020:00080000:3.0:1736271501.509153:0:19949:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 192.168.203.38@tcp (ffff88009be2c800): rc 0 00010000:00010000:0.0:1736271501.509154:0:3319:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998d80/0xed4dbb87898d47d9 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509156:0:3319:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998d80/0xed4dbb87898d47d9 lrc: 4/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1736271501.509156:0:19949:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff880075c9c000), last request at 1736271500 00000020:00000080:3.0:1736271501.509159:0:19949:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xed4dbb87898d4524 00010000:00010000:0.0:1736271501.509160:0:3319:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7fda96f6 (ffff88012b370100) 00010000:00010000:0.0:1736271501.509161:0:3319:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1736271501.509161:0:3319:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998d80/0xed4dbb87898d47d9 lrc: 2/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271501.509162:0:9291:0:(ldlm_lock.c:2634:ldlm_export_cancel_blocked_locks()) Export ffff88009be2c800, canceled 0 locks, left on hash table 1. 00000100:00080000:3.0:1736271501.509162:0:19949:0:(import.c:86:import_set_state_nolock()) ffff880075c99000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:0.0:1736271501.509164:0:3319:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a998d80/0xed4dbb87898d47d9 lrc: 0/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736271501.509176:0:9291:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008cdbb180/0xed4dbb87898d4777 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x252fa6fdbb94bcab expref: 2 pid: 27660 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736271501.509177:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1736271501.509186:0:19949:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 0@lo (ffff880075c9c000): rc 0 00010000:00010000:2.0:1736271501.509188:0:9291:0:(ldlm_lock.c:2662:ldlm_export_cancel_locks()) Export ffff88009be2c800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1736271501.509188:0:19949:0:(genops.c:985:class_export_put()) final put ffff880075c9c000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1736271501.509200:0:19949:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88008f18b000), last request at 1736271500 00000020:00000080:3.0:1736271501.509203:0:19949:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xed4dbb87898d451d 00000020:00000080:0.0:1736271501.509205:0:19360:0:(genops.c:944:class_export_destroy()) destroying export ffff880075c9c000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00080000:3.0:1736271501.509206:0:19949:0:(import.c:86:import_set_state_nolock()) ffff88008f18e800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000020:00000080:0.0:1736271501.509234:0:19360:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff880075c99000 for lustre-MDT0000 00010000:00010000:1.0:1736271501.509243:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1736271501.509243:0:19949:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 0@lo (ffff88008f18b000): rc 0 00000020:00000080:3.0:1736271501.509245:0:19949:0:(genops.c:985:class_export_put()) final put ffff88008f18b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1736271501.509251:0:19949:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88008f18d800), last request at 1736271500 00000020:00000080:3.0:1736271501.509254:0:19949:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xed4dbb87898d4516 00000020:00000080:1.0:1736271501.509256:0:29989:0:(genops.c:944:class_export_destroy()) destroying export ffff88008f18b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1736271501.509283:0:19949:0:(import.c:86:import_set_state_nolock()) ffff88008f18c800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:0.0:1736271501.509294:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1736271501.509307:0:29989:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88008f18e800 for lustre-MDT0000 00000020:00080000:3.0:1736271501.509326:0:19949:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 0@lo (ffff88008f18d800): rc 0 00000020:00000080:3.0:1736271501.509328:0:19949:0:(genops.c:985:class_export_put()) final put ffff88008f18d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1736271501.509335:0:19949:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88008faa9000), last request at 1736271500 00000020:00000080:3.0:1736271501.509338:0:19949:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xed4dbb87898d4380 00000020:00000080:1.0:1736271501.509340:0:29989:0:(genops.c:944:class_export_destroy()) destroying export ffff88008f18d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:3.0:1736271501.509340:0:19949:0:(import.c:86:import_set_state_nolock()) ffff88008faaf000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:0.0:1736271501.509352:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1736271501.509362:0:29989:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88008f18c800 for lustre-MDT0000 00000020:00080000:3.0:1736271501.509363:0:19949:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 0@lo (ffff88008faa9000): rc 0 00000020:00000080:3.0:1736271501.509364:0:19949:0:(genops.c:985:class_export_put()) final put ffff88008faa9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1736271501.509370:0:29989:0:(genops.c:944:class_export_destroy()) destroying export ffff88008faa9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000100:00080000:3.0:1736271501.509390:0:19949:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000020:00000080:1.0:1736271501.509391:0:29989:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88008faaf000 for lustre-MDT0000 00000100:00100000:3.0:1736271501.509391:0:19949:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1736271501.509395:0:19949:0:(pinger.c:414:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1736271501.509403:0:19949:0:(import.c:86:import_set_state_nolock()) ffff880073631000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1736271501.509410:0:19949:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf59300 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:19949:1820604024052736:0@lo:39:umount.0 00000100:00100000:3.0:1736271501.509432:0:19949:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271501.509453:0:19949:0:(client.c:2492:ptlrpc_set_wait()) set ffff880137380000 going to sleep for 5 seconds 00000100:00100000:1.0:1736271501.509470:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052736 00000100:00100000:1.0:1736271501.509487:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112755 00000100:00100000:1.0:1736271501.509489:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:19949:x1820604024052736:12345-0@lo:39:umount.0 00000020:00000080:1.0:1736271501.509500:0:27358:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xed4dbb87898d43b1 00000100:00080000:1.0:1736271501.509503:0:27358:0:(import.c:86:import_set_state_nolock()) ffff88009b34b000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:0.0:1736271501.509535:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1736271501.509537:0:27358:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 41, last_transno is 176093659207 00000100:00100000:1.0:1736271501.509616:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+2:19949:x1820604024052736:12345-0@lo:39:umount.0 Request processed in 126us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271501.509621:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112755 00000100:00100000:3.0:1736271501.509633:0:19949:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf59300 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:19949:1820604024052736:0@lo:39:umount.0 00000100:00080000:3.0:1736271501.509642:0:19949:0:(import.c:86:import_set_state_nolock()) ffff880073631000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1736271501.509645:0:19949:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1736271501.509647:0:19949:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1736271501.509648:0:19949:0:(import.c:339:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1736271501.511372:0:19949:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1736271501.511374:0:19949:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 85899347174 gen 3 00000004:00080000:3.0:1736271501.511386:0:19949:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00080000:3.0:1736271501.511388:0:19949:0:(pinger.c:414:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1736271501.511395:0:19949:0:(import.c:86:import_set_state_nolock()) ffff88009c662800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1736271501.511400:0:19949:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf59300 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:19949:1820604024052800:0@lo:9:umount.0 00000100:00100000:3.0:1736271501.511417:0:19949:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271501.511425:0:19949:0:(client.c:2492:ptlrpc_set_wait()) set ffff880137380000 going to sleep for 5 seconds 00000100:00100000:0.0:1736271501.511436:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052800 00000100:00100000:0.0:1736271501.511458:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121025 00000100:00100000:0.0:1736271501.511461:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:19949:x1820604024052800:12345-0@lo:9:umount.0 00000020:00000080:0.0:1736271501.511473:0:23102:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xed4dbb87898d43d4 00000100:00080000:0.0:1736271501.511476:0:23102:0:(import.c:86:import_set_state_nolock()) ffff88009c9f7800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000001:00000004:0.0:1736271501.511503:0:23102:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 20, last_transno is 85899347174 00010000:00010000:1.0:1736271501.511515:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271501.511563:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+2:19949:x1820604024052800:12345-0@lo:9:umount.0 Request processed in 102us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271501.511567:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121025 00000100:00100000:3.0:1736271501.511569:0:19949:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf59300 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:19949:1820604024052800:0@lo:9:umount.0 00000100:00080000:3.0:1736271501.511575:0:19949:0:(import.c:86:import_set_state_nolock()) ffff88009c662800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1736271501.511579:0:19949:0:(osp_dev.c:1590:osp_import_event()) got disconnected 00000004:00080000:3.0:1736271501.511579:0:19949:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00080000:3.0:1736271501.511580:0:19949:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1736271501.511581:0:19949:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 85899347174 gen 4 00000004:00080000:3.0:1736271501.511582:0:19949:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00100000:3.0:1736271501.511583:0:19949:0:(import.c:339:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1736271501.511672:0:19949:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1736271501.511674:0:19949:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 3 00000004:00080000:3.0:1736271501.511685:0:19949:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00080000:3.0:1736271501.511686:0:19949:0:(pinger.c:414:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1736271501.511694:0:19949:0:(import.c:86:import_set_state_nolock()) ffff88009c665800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1736271501.511700:0:19949:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf59300 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:19949:1820604024052864:0@lo:9:umount.0 00000100:00100000:3.0:1736271501.511719:0:19949:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271501.511734:0:19949:0:(client.c:2492:ptlrpc_set_wait()) set ffff880137380000 going to sleep for 5 seconds 00000100:00100000:0.0:1736271501.511764:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052864 00000100:00100000:0.0:1736271501.511780:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121026 00000100:00100000:0.0:1736271501.511783:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:19949:x1820604024052864:12345-0@lo:9:umount.0 00000020:00000080:0.0:1736271501.511796:0:23102:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xed4dbb87898d43e9 00000100:00080000:0.0:1736271501.511800:0:23102:0:(import.c:86:import_set_state_nolock()) ffff88009b34b800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000001:00000004:0.0:1736271501.511823:0:23102:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4295015870 00010000:00010000:1.0:1736271501.511835:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271501.511887:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+2:19949:x1820604024052864:12345-0@lo:9:umount.0 Request processed in 102us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271501.511892:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121026 00000100:00100000:3.0:1736271501.511899:0:19949:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf59300 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:19949:1820604024052864:0@lo:9:umount.0 00000100:00080000:3.0:1736271501.511908:0:19949:0:(import.c:86:import_set_state_nolock()) ffff88009c665800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1736271501.511913:0:19949:0:(osp_dev.c:1590:osp_import_event()) got disconnected 00000004:00080000:3.0:1736271501.511914:0:19949:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00080000:3.0:1736271501.511920:0:19949:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1736271501.511921:0:19949:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 4 00000004:00080000:3.0:1736271501.511925:0:19949:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00100000:3.0:1736271501.511926:0:19949:0:(import.c:339:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00080000:3.0:1736271501.512072:0:19949:0:(genops.c:1530:class_disconnect_exports()) OBD device 5 (ffff88012c7ad0c0) has no exports 00000020:00080000:0.0:1736271501.512115:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88006eb606c0 refcount 1 committed 1 result 0 batchid 511101108248 00000020:00080000:0.0:1736271501.512119:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a7e79800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512121:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].2 00000020:00080000:0.0:1736271501.512123:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a7e79b00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512125:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].1 00000020:00080000:0.0:1736271501.512134:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880099c48840 refcount 1 committed 1 result 0 batchid 511101108249 00000020:00080000:0.0:1736271501.512136:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a7e79a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512139:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].3 00000020:00080000:0.0:1736271501.512140:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a7e79e00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512142:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].2 00000020:00080000:0.0:1736271501.512145:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880099c480c0 refcount 1 committed 1 result 0 batchid 511101108250 00000020:00080000:0.0:1736271501.512147:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a7e79600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512149:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].4 00000020:00080000:0.0:1736271501.512150:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a7e79c00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512152:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].3 00000020:00080000:0.0:1736271501.512154:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880099c48540 refcount 1 committed 1 result 0 batchid 511101108251 00000020:00080000:0.0:1736271501.512156:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a7e79300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512157:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].5 00000020:00080000:0.0:1736271501.512159:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a7e79000 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512160:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].4 00000020:00080000:0.0:1736271501.512163:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012c35f600 refcount 1 committed 1 result 0 batchid 511101108252 00000020:00080000:0.0:1736271501.512164:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a7e79f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512166:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].6 00000020:00080000:0.0:1736271501.512167:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a7e79500 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512169:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].5 00000020:00080000:0.0:1736271501.512172:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012c35f480 refcount 1 committed 1 result 0 batchid 511101108253 00000020:00080000:0.0:1736271501.512174:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b48e5400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512175:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].7 00000020:00080000:0.0:1736271501.512176:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b48e5100 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512181:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].6 00000020:00080000:0.0:1736271501.512184:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012c35f3c0 refcount 1 committed 1 result 0 batchid 511101108254 00000020:00080000:0.0:1736271501.512186:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d1f0200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512188:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].8 00000020:00080000:0.0:1736271501.512190:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d1f0000 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512192:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].7 00000020:00080000:0.0:1736271501.512196:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800b4043b40 refcount 1 committed 1 result 0 batchid 511101108255 00000020:00080000:0.0:1736271501.512198:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d1f0100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512200:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].9 00000020:00080000:0.0:1736271501.512202:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d1f0f00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512204:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].8 00000020:00080000:0.0:1736271501.512207:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009bdd0180 refcount 1 committed 1 result 0 batchid 511101108256 00000020:00080000:0.0:1736271501.512209:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008db62f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512211:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].10 00000020:00080000:0.0:1736271501.512213:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d1f0a00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512215:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].9 00000020:00080000:0.0:1736271501.512219:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009bdd0900 refcount 1 committed 1 result 0 batchid 511101108257 00000020:00080000:0.0:1736271501.512221:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008db62300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512223:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].11 00000020:00080000:0.0:1736271501.512225:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008db62000 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512227:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].10 00000020:00080000:0.0:1736271501.512230:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009bdd09c0 refcount 1 committed 1 result 0 batchid 511101108258 00000020:00080000:0.0:1736271501.512232:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008db62100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512234:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].12 00000020:00080000:0.0:1736271501.512239:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008db62900 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512242:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].11 00000020:00080000:0.0:1736271501.512245:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008cf3a3c0 refcount 1 committed 1 result 0 batchid 511101108259 00000020:00080000:0.0:1736271501.512247:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008db62500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512250:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].13 00000020:00080000:0.0:1736271501.512252:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008db62800 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512254:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].12 00000020:00080000:0.0:1736271501.512257:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800a90c03c0 refcount 1 committed 1 result 0 batchid 511101108260 00000020:00080000:0.0:1736271501.512277:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008db62d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512279:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].14 00000020:00080000:0.0:1736271501.512281:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008db62e00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512283:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].13 00000020:00080000:0.0:1736271501.512287:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800a90c0d80 refcount 1 committed 1 result 0 batchid 511101108261 00000020:00080000:0.0:1736271501.512289:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008db62700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512292:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].16 00000020:00080000:0.0:1736271501.512293:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008db62b00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512295:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].14 00000020:00080000:0.0:1736271501.512298:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8801311c4900 refcount 1 committed 1 result 0 batchid 511101108262 00000020:00080000:0.0:1736271501.512300:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008f07d500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512303:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].17 00000020:00080000:0.0:1736271501.512304:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008f07d700 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512306:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].16 00000020:00080000:0.0:1736271501.512310:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8801311c40c0 refcount 1 committed 1 result 0 batchid 511101108263 00000020:00080000:0.0:1736271501.512312:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008f07d400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512318:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].18 00000020:00080000:0.0:1736271501.512320:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008f07d600 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512322:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].17 00000020:00080000:0.0:1736271501.512326:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8801311c4840 refcount 1 committed 1 result 0 batchid 511101108264 00000020:00080000:0.0:1736271501.512327:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007d7b8f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512329:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].19 00000020:00080000:0.0:1736271501.512331:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007d7b8900 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512333:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].18 00000020:00080000:0.0:1736271501.512336:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008cf3ab40 refcount 1 committed 1 result 0 batchid 511101108265 00000020:00080000:0.0:1736271501.512338:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007d7b8100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512340:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].20 00000020:00080000:0.0:1736271501.512342:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007d7b8700 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512344:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].19 00000020:00080000:0.0:1736271501.512347:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88007d792c00 refcount 1 committed 1 result 0 batchid 511101108266 00000020:00080000:0.0:1736271501.512348:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007d7b8800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512350:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].21 00000020:00080000:0.0:1736271501.512352:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007d7b8e00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512353:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].20 00000020:00080000:0.0:1736271501.512357:0:18290:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88007d792600 refcount 1 committed 1 result 0 batchid 511101108267 00000020:00080000:0.0:1736271501.512359:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007d7b8a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512361:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40013c81:0x2].22 00000020:00080000:0.0:1736271501.512362:0:18290:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88007d7b8c00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:0.0:1736271501.512364:0:18290:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3b550:0x2].21 00000020:00000080:2.0:1736271501.521935:0:9291:0:(genops.c:985:class_export_put()) final put ffff88009be2c800/64bb3b11-afd7-4230-a38c-2a374f07ba02 00010000:00010000:2.0:1736271501.521967:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271501.521969:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271501.521971:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1736271501.522013:0:29989:0:(genops.c:944:class_export_destroy()) destroying export ffff88009be2c800/64bb3b11-afd7-4230-a38c-2a374f07ba02 for lustre-MDT0000 00000020:00000080:1.0:1736271501.522061:0:29989:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88009be2f800 for lustre-MDT0000 00010000:00010000:2.0:1736271502.180434:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271503.182446:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271504.184463:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271504.374440:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271504.374445:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736271504.374458:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800998dd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024052992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271504.374458:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024052928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271504.374512:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271504.374540:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052992 00000100:00100000:3.0:1736271504.374562:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271504.374585:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024052928 00000100:00100000:3.0:1736271504.374595:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5758 00000100:00100000:2.0:1736271504.374600:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5759 00000100:00100000:3.0:1736271504.374600:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b35e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024052992:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271504.374604:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf59300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024052928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271504.374621:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3906641920 avail 3675119616 00002000:00000024:3.0:1736271504.374621:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8577856 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271504.374655:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf59300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024052928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271504.374661:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5759 00000100:00100000:3.0:1736271504.374661:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b35e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024052992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271504.374667:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5758 00000100:00100000:0.0:1736271504.374679:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024052928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271504.374696:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800998dd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024052992:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736271505.186452:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271505.452527:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271505.452573:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271505.452604:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271505.452614:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058964288 00000100:00100000:0.0:1736271505.452625:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271505.452633:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058964352 00000100:00100000:2.0:1736271505.452658:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 164 00000100:00100000:3.0:1736271505.452660:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058964416 00000100:00100000:2.0:1736271505.452663:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058964288:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271505.452666:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271505.452678:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 627 00000100:00100000:3.0:1736271505.452683:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058964416:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271505.452689:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 834 00000100:00100000:1.0:1736271505.452690:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058964544 00000100:00100000:0.0:1736271505.452693:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1895:x1820604058964352:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000020:00080000:0.0:1736271505.452701:0:27148:0:(tgt_handler.c:780:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.38@tcp 00000100:00100000:2.0:1736271505.452732:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058964288:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 68us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271505.452732:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058964416:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 48us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271505.452738:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 164 00000100:00100000:3.0:1736271505.452740:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 627 00000100:00100000:0.0:1736271505.452748:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1895:x1820604058964352:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 54us (174us total) trans 0 rc -107/-107 00000100:00100000:1.0:1736271505.452749:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058964480 00000100:00100000:0.0:1736271505.452754:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 834 00000100:00100000:3.0:1736271505.452764:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6954 00000100:00100000:3.0:1736271505.452767:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ea140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1894:x1820604058964544:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271505.452779:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6955 00000100:00100000:1.0:1736271505.452783:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934eed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1895:x1820604058964480:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271505.452785:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ea140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1894:x1820604058964544:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 18us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271505.452789:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6954 00000100:00100000:1.0:1736271505.452812:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934eed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1895:x1820604058964480:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 29us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271505.452818:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6955 00000100:00100000:0.0:1736271505.453652:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271505.453689:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058964608 00000100:00100000:3.0:1736271505.453709:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 835 00000100:00100000:3.0:1736271505.453713:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058964608:12345-192.168.203.38@tcp:38:ptlrpcd_01_01.0 00010000:02000000:3.0:1736271505.453741:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271505.457429:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058964608:12345-192.168.203.38@tcp:38:ptlrpcd_01_01.0 Request processed in 3714us (3776us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271505.457437:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 835 00000100:00100000:1.0:1736271505.686511:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800998d9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024053056:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271505.686512:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800998dcc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1820604024053248:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271505.686524:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800998d8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1820604024053120:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271505.686550:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800998da140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024053184:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271505.686571:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271505.686575:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271505.686587:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800998da600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024053312:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271505.686598:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053056 00000100:00100000:0.0:1736271505.686599:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271505.686612:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb917c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024053504:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271505.686617:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053248 00000100:00100000:0.0:1736271505.686627:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800998dd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024053376:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271505.686635:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053120 00000100:00100000:2.0:1736271505.686637:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1736271505.686638:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271505.686643:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024053056:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271505.686644:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:1.0:1736271505.686647:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3333:x1820604024053248:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271505.686650:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1736271505.686651:0:27148:0:(tgt_handler.c:780:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1736271505.686653:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736271505.686658:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008f127200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3333:1820604024053568:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271505.686676:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3333:x1820604024053248:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (102us total) trans 0 rc -107/-107 00000100:00100000:0.0:1736271505.686679:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053376 00000100:00100000:3.0:1736271505.686680:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271505.686681:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:2.0:1736271505.686684:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024053056:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271505.686690:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1736271505.686691:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053568 00000100:00100000:0.0:1736271505.686699:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112756 00000100:00100000:1.0:1736271505.686699:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:1.0:1736271505.686701:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3335:x1820604024053120:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271505.686703:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b10980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3335:x1820604024053376:12345-0@lo:400:kworker/u8:2.0 00000020:00080000:1.0:1736271505.686705:0:27148:0:(tgt_handler.c:780:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:3.0:1736271505.686705:0:3333:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@192.168.203.138@tcp abruptly disconnected: reconnecting 00000020:00080000:0.0:1736271505.686708:0:27358:0:(tgt_handler.c:780:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:3.0:1736271505.686710:0:3333:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1736271505.686729:0:3333:0:(import.c:200:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1736271505.686732:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736271505.686733:0:3333:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271505.686736:0:3333:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8095 00000100:00100000:1.0:1736271505.686741:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3335:x1820604024053120:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (142us total) trans 0 rc -107/-107 00000100:00080000:3.0:1736271505.686741:0:3333:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271505.686744:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800998d97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024053440:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271505.686746:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:0.0:1736271505.686752:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b10980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3335:x1820604024053376:12345-0@lo:400:kworker/u8:2.0 Request processed in 48us (102us total) trans 0 rc -107/-107 00000100:00100000:1.0:1736271505.686757:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053184 00000100:00100000:0.0:1736271505.686758:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112756 00000100:00100000:3.0:1736271505.686758:0:3333:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b283dc0 x1820604024053632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271505.686763:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271505.686770:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1736271505.686773:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aaf8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024053184:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271505.686774:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800998dcc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1820604024053248:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271505.686784:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b283dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024053632:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1736271505.686789:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053504 00000100:00100000:3.0:1736271505.686799:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1736271505.686803:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3333:x1820604024053568:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271505.686804:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1736271505.686808:0:3854:0:(tgt_handler.c:780:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1736271505.686809:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053440 00000100:00100000:1.0:1736271505.686820:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aaf8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024053184:12345-0@lo:400:kworker/u8:2.0 Request processed in 46us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271505.686825:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1736271505.686832:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6956 00000100:00080000:0.0:1736271505.686834:0:3335:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@192.168.203.138@tcp abruptly disconnected: reconnecting 00000100:00100000:3.0:1736271505.686834:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3333:x1820604024053568:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (155us total) trans 0 rc -107/-107 00000100:00080000:0.0:1736271505.686836:0:3335:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:2.0:1736271505.686836:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9ef200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024053504:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271505.686837:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053632 00000100:02000400:0.0:1736271505.686840:0:3335:0:(import.c:200:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1736271505.686840:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00080000:0.0:1736271505.686842:0:3335:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271505.686845:0:3335:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8095 00000100:00100000:1.0:1736271505.686845:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:1.0:1736271505.686848:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b99f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024053632:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1736271505.686849:0:3335:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00010000:02000000:1.0:1736271505.686860:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271505.686861:0:3335:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084648980 x1820604024053696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:3.0:1736271505.686861:0:3333:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@192.168.203.138@tcp abruptly disconnected: reconnecting 00000100:00100000:2.0:1736271505.686863:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9ef200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024053504:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (225us total) trans 0 rc 0/0 00000100:00080000:3.0:1736271505.686863:0:3333:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1736271505.686865:0:3333:0:(import.c:200:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1736271505.686867:0:3333:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736271505.686868:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6956 00000100:00080000:3.0:1736271505.686870:0:3333:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8095 00000100:00080000:3.0:1736271505.686873:0:3333:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271505.686874:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800998d8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1820604024053120:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271505.686877:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6957 00000100:00100000:2.0:1736271505.686879:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024053440:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271505.686883:0:3335:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@192.168.203.138@tcp abruptly disconnected: reconnecting 00000100:00100000:1.0:1736271505.686883:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b99f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024053632:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 34us (79us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271505.686883:0:3333:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b284c00 x1820604024053760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271505.686885:0:3335:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1736271505.686887:0:3335:0:(import.c:200:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1736271505.686888:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00080000:0.0:1736271505.686890:0:3335:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271505.686892:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008f127200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3333:1820604024053568:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271505.686893:0:3335:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8275 00000100:00080000:0.0:1736271505.686895:0:3335:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271505.686898:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024053440:12345-0@lo:400:kworker/u8:2.0 Request processed in 18us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271505.686903:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6957 00000100:00100000:0.0:1736271505.686904:0:3335:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008464cc00 x1820604024053824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271505.686904:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb917c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024053504:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271505.686912:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800998dd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024053376:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271505.686914:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271505.686926:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800998da140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024053184:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271505.686930:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084648980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024053696:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1736271505.686933:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053312 00000100:00100000:2.0:1736271505.686934:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800998d97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024053440:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271505.686935:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800998d9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024053056:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271505.686948:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271505.686956:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b284c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024053760:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1736271505.686957:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1736271505.686961:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3584c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024053312:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271505.686962:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053696 00000100:00100000:0.0:1736271505.686969:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271505.686976:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053760 00000100:00100000:0.0:1736271505.686980:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024053824:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1736271505.686992:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3584c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024053312:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271505.686998:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:0.0:1736271505.687001:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271505.687009:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:3.0:1736271505.687012:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084649c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024053696:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1736271505.687013:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271505.687015:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00080000:0.0:1736271505.687016:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271505.687017:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024053760:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1736271505.687018:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b283dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024053632:0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1736271505.687018:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736271505.687022:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271505.687034:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084649c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024053696:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 21us (87us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736271505.687035:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271505.687037:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271505.687038:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:1.0:1736271505.687039:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024053760:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 21us (71us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271505.687040:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084648980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024053696:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1736271505.687044:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00080000:0.0:1736271505.687047:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271505.687048:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271505.687050:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b284c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024053760:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1736271505.687059:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800998da600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024053312:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271505.687068:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053824 00000100:00100000:0.0:1736271505.687082:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112757 00000100:00100000:0.0:1736271505.687085:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024053824:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1736271505.687091:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271505.687111:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024053824:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 25us (110us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271505.687116:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112757 00000100:00080000:2.0:1736271505.687125:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271505.687127:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271505.687131:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024053824:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1736271506.188469:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271507.190484:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1736271507.367309:0:8105:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1736271507.367316:0:8105:0:(genops.c:985:class_export_put()) final put ffff88009b34d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1736271507.367406:0:19360:0:(genops.c:944:class_export_destroy()) destroying export ffff88009b34d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1736271507.367487:0:19360:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88009b34b000 for lustre-MDT0001 00000001:00100000:0.0:1736271507.383153:0:25514:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1736271507.383160:0:25514:0:(genops.c:985:class_export_put()) final put ffff88009c9f1800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1736271507.383165:0:10487:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1736271507.383168:0:10487:0:(genops.c:985:class_export_put()) final put ffff88009c666800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1736271507.383246:0:19360:0:(genops.c:944:class_export_destroy()) destroying export ffff88009c9f1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1736271507.383358:0:19360:0:(genops.c:944:class_export_destroy()) destroying export ffff88009c666800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1736271507.383393:0:19360:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88009c9f7800 for lustre-OST0000 00000020:00000080:3.0:1736271507.383397:0:19360:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88009b34b800 for lustre-OST0001 00010000:00010000:2.0:1736271508.192466:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271509.194469:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271509.382465:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084648980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024053888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271509.382488:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024053952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271509.382537:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271509.382585:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271509.382602:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053888 00000100:00100000:2.0:1736271509.382613:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024053952 00000100:00100000:0.0:1736271509.382647:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5760 00000100:00100000:2.0:1736271509.382651:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5761 00000100:00100000:0.0:1736271509.382652:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024053888:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271509.382653:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b283900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024053952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271509.382673:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271509.382673:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8577856 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271509.382729:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b283900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024053952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271509.382734:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024053888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271509.382735:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5761 00000100:00100000:0.0:1736271509.382741:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5760 00000100:00100000:2.0:1736271509.382774:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084648980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024053888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271509.382775:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024053952:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736271510.196441:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271510.460564:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271510.460604:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271510.460633:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058964672 00000100:00100000:0.0:1736271510.460637:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271510.460653:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271510.460674:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 166 00000100:00100000:2.0:1736271510.460678:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058964672:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271510.460694:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058964864 00000100:00100000:0.0:1736271510.460707:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271510.460717:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058964928 00000100:00100000:3.0:1736271510.460725:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6958 00000100:00100000:0.0:1736271510.460729:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058964800 00000100:00100000:3.0:1736271510.460730:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1895:x1820604058964864:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271510.460734:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6959 00000100:00100000:1.0:1736271510.460737:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084648980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1894:x1820604058964928:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271510.460751:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058964736 00000100:00100000:2.0:1736271510.460762:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058964672:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271510.460762:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1895:x1820604058964864:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 32us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271510.460764:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 630 00000100:00100000:3.0:1736271510.460767:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6958 00000100:00100000:0.0:1736271510.460769:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058964800:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271510.460769:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 166 00000100:00100000:1.0:1736271510.460773:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084648980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1894:x1820604058964928:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 34us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271510.460779:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6959 00000100:00100000:3.0:1736271510.460787:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 842 00000100:00100000:3.0:1736271510.460789:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058964736:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:0.0:1736271510.460795:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058964800:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 26us (159us total) trans 0 rc 0/0 00010000:02000000:3.0:1736271510.460798:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271510.460801:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 630 00000100:00100000:3.0:1736271510.460813:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058964736:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 22us (107us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271510.460816:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 842 00000100:00080000:2.0:1736271510.694427:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271510.694433:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271510.694436:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271510.694441:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8291 00000100:00080000:2.0:1736271510.694445:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271510.694450:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271510.694456:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aafd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024054016:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271510.694465:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009aafe880 x1820604024054080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271510.694497:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aafe880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024054080:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271510.694508:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271510.694511:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271510.694512:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271510.694515:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8291 00000100:00100000:3.0:1736271510.694526:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271510.694527:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271510.694531:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271510.694541:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009351ed40 x1820604024054208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271510.694545:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271510.694552:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736271510.694558:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009351da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024054144:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271510.694561:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271510.694563:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271510.694564:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009351ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024054208:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271510.694564:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271510.694566:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8291 00000100:00080000:2.0:1736271510.694567:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271510.694569:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271510.694571:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d4e6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024054272:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271510.694575:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009a831c80 x1820604024054336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271510.694576:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271510.694588:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271510.694589:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271510.694589:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271510.694590:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271510.694592:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8291 00000100:00080000:2.0:1736271510.694593:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00100000:3.0:1736271510.694593:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009a832f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024054464:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271510.694594:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271510.694599:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013733df00 x1820604024054528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271510.694603:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009a831c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024054336:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271510.694605:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271510.694619:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009a833440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024054400:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271510.694626:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271510.694627:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271510.694639:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271510.694641:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013733df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024054528:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271510.694646:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054336 00000100:00100000:3.0:1736271510.694653:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054464 00000100:00100000:1.0:1736271510.694658:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271510.694664:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054080 00000100:00100000:0.0:1736271510.694667:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112758 00000100:00100000:3.0:1736271510.694670:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054400 00000100:00100000:0.0:1736271510.694671:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b35bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024054336:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271510.694675:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054144 00000100:00100000:3.0:1736271510.694678:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6960 00000100:00100000:1.0:1736271510.694697:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054208 00000100:00100000:3.0:1736271510.694700:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b283440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024054464:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271510.694705:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054272 00000100:00100000:1.0:1736271510.694710:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054528 00000100:00100000:2.0:1736271510.694712:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00010000:02000000:0.0:1736271510.694715:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271510.694719:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2863c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024054144:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271510.694725:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:3.0:1736271510.694727:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b283440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024054464:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271510.694730:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024054272:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271510.694731:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6960 00000100:00100000:3.0:1736271510.694740:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6961 00000100:00100000:2.0:1736271510.694742:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2863c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024054144:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271510.694742:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024054400:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271510.694744:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b35bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024054336:12345-0@lo:38:kworker/u8:2.0 Request processed in 73us (118us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271510.694745:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:0.0:1736271510.694750:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112758 00000100:00100000:2.0:1736271510.694754:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:2.0:1736271510.694756:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b35d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024054080:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271510.694756:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024054400:12345-0@lo:400:kworker/u8:2.0 Request processed in 13us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271510.694759:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6961 00000100:00100000:1.0:1736271510.694760:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024054272:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (155us total) trans 0 rc 0/0 00010000:02000000:2.0:1736271510.694761:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271510.694766:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:3.0:1736271510.694772:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:2.0:1736271510.694774:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b35d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024054080:12345-0@lo:38:kworker/u8:2.0 Request processed in 18us (231us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271510.694774:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b35f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024054208:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271510.694777:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1736271510.694778:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d4e6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024054272:0@lo:400:kworker/u8:2.0 00010000:02000000:3.0:1736271510.694779:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271510.694780:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea60980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024054528:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271510.694780:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:3.0:1736271510.694790:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b35f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024054208:12345-0@lo:38:kworker/u8:2.0 Request processed in 15us (201us total) trans 0 rc -19/-19 00010000:02000000:1.0:1736271510.694793:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271510.694793:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1736271510.694798:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054016 00000100:00100000:2.0:1736271510.694806:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009a833440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024054400:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271510.694812:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea60980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024054528:12345-0@lo:38:kworker/u8:2.0 Request processed in 31us (154us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271510.694812:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009a832f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024054464:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271510.694817:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:3.0:1736271510.694817:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009351da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024054144:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271510.694823:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1736271510.694826:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024054016:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271510.694844:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271510.694847:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271510.694850:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013733df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024054528:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271510.694855:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024054016:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (330us total) trans 0 rc 0/0 00000100:00080000:1.0:1736271510.694857:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271510.694859:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271510.694859:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aafd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024054016:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271510.694860:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1736271510.694862:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009a831c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024054336:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271510.694868:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271510.694870:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271510.694872:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009351ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024054208:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271510.694879:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271510.694881:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271510.694883:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aafe880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024054080:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271511.198451:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271512.200550:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271513.202455:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271514.204433:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271514.390404:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013733c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024054592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271514.390433:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736271514.390447:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024054656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271514.390456:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271514.390488:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271514.390499:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054592 00000100:00100000:2.0:1736271514.390508:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054656 00000100:00100000:2.0:1736271514.390534:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5762 00000100:00100000:2.0:1736271514.390538:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b282f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024054656:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271514.390540:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5763 00000100:00100000:0.0:1736271514.390544:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024054592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271514.390555:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8577856 pending 0 free 3923451904 avail 3691929600 00002000:00000024:0.0:1736271514.390557:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271514.390587:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024054592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271514.390591:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5763 00000100:00100000:2.0:1736271514.390595:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b282f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024054656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271514.390601:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5762 00000100:00100000:3.0:1736271514.390627:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024054656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271514.390628:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013733c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024054592:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1736271515.206445:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271515.468516:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271515.468568:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271515.468596:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271515.468606:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058964992 00000100:00100000:0.0:1736271515.468609:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271515.468637:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965184 00000100:00100000:2.0:1736271515.468678:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 168 00000100:00100000:2.0:1736271515.468684:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058964992:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271515.468691:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6962 00000100:00100000:3.0:1736271515.468694:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1895:x1820604058965184:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271515.468703:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271515.468716:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965056 00000100:00100000:0.0:1736271515.468729:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965248 00000100:00100000:2.0:1736271515.468745:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058964992:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 61us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271515.468745:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1895:x1820604058965184:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271515.468749:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6962 00000100:00100000:1.0:1736271515.468750:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965120 00000100:00100000:2.0:1736271515.468751:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 168 00000100:00100000:0.0:1736271515.468752:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6963 00000100:00100000:0.0:1736271515.468756:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1895:x1820604058965248:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271515.468774:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 633 00000100:00100000:1.0:1736271515.468779:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131a85f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058965120:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271515.468780:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 846 00000100:00100000:0.0:1736271515.468784:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1895:x1820604058965248:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 27us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271515.468784:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131a804c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058965056:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:0.0:1736271515.468790:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6963 00010000:02000000:2.0:1736271515.468798:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271515.468828:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131a85f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058965120:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 49us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271515.468830:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131a804c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058965056:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 46us (233us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271515.468833:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 633 00000100:00100000:2.0:1736271515.468837:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 846 00000020:02000400:0.0:1736271515.538395:0:19949:0:(genops.c:1786:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 4. Is it stuck? 00000020:02000400:0.0:1736271515.541938:0:19949:0:(genops.c:1752:print_export_data()) lustre-MDT0000: UNLINKED ffff88008faa8000 64bb3b11-afd7-4230-a38c-2a374f07ba02 192.168.203.38@tcp 1 (0 0 0) 1 0 1 0: (null) 523986010115 stale:0 00000100:00080000:2.0:1736271515.702447:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271515.702452:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271515.702455:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271515.702461:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8296 00000100:00080000:2.0:1736271515.702465:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271515.702469:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271515.702487:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013733df00 x1820604024054784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271515.702495:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013733c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024054720:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271515.702519:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271515.702521:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271515.702522:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271515.702523:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8296 00000100:00080000:2.0:1736271515.702524:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271515.702527:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271515.702548:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009a832f80 x1820604024054912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271515.702556:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271515.702561:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271515.702563:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013733df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024054784:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271515.702564:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271515.702565:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271515.702568:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8296 00000100:00080000:2.0:1736271515.702569:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271515.702572:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271515.702583:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009aae7200 x1820604024055040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271515.702592:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009a831c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024054848:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271515.702597:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271515.702617:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271515.702620:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009a832f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024054912:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271515.702621:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271515.702622:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271515.702625:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8296 00000100:00100000:3.0:1736271515.702625:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054720 00000100:00080000:2.0:1736271515.702627:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271515.702630:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271515.702638:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d6880 x1820604024055232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271515.702640:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024055104:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271515.702670:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271515.702677:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1736271515.702682:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024054720:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271515.702687:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271515.702688:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aae7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024055040:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271515.702691:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009a833440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024054976:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271515.702709:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271515.702714:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024055168:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271515.702722:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271515.702725:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024054720:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271515.702731:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271515.702731:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271515.702732:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1736271515.702735:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024055232:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271515.702755:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055104 00000100:00100000:1.0:1736271515.702755:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271515.702760:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271515.702762:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055040 00000100:00100000:0.0:1736271515.702779:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055168 00000100:00100000:2.0:1736271515.702781:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112759 00000100:00100000:1.0:1736271515.702783:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054784 00000100:00100000:3.0:1736271515.702783:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054912 00000100:00100000:2.0:1736271515.702784:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea66d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024055040:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271515.702792:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6964 00000100:00100000:3.0:1736271515.702795:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054976 00000100:00100000:0.0:1736271515.702796:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024055104:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271515.702796:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055232 00010000:02000000:2.0:1736271515.702796:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271515.702806:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024054848 00000100:00100000:3.0:1736271515.702808:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1736271515.702810:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024054976:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271515.702817:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:0.0:1736271515.702825:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024055104:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271515.702827:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024054848:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271515.702830:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6964 00000100:00100000:3.0:1736271515.702836:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024054976:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271515.702839:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea66d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024055040:12345-0@lo:38:kworker/u8:2.0 Request processed in 54us (117us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271515.702840:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6965 00000100:00100000:0.0:1736271515.702843:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb16d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024055168:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271515.702849:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:2.0:1736271515.702850:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112759 00000100:00100000:1.0:1736271515.702860:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024054848:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271515.702860:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:0.0:1736271515.702862:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb16d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024055168:12345-0@lo:400:kworker/u8:2.0 Request processed in 19us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271515.702863:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024054912:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271515.702866:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:0.0:1736271515.702867:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6965 00010000:02000000:3.0:1736271515.702869:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271515.702872:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1736271515.702875:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea67200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024054784:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271515.702879:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:1.0:1736271515.702881:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea604c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024055232:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271515.702882:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271515.702886:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024054912:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (216us total) trans 0 rc -19/-19 00010000:02000000:1.0:1736271515.702887:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271515.702890:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:0.0:1736271515.702902:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024055168:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271515.702909:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea67200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024054784:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (313us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271515.702912:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024055104:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271515.702912:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea604c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024055232:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (157us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271515.702914:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:1.0:1736271515.702918:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00080000:1.0:1736271515.702943:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271515.702946:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271515.702949:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aae7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024055040:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271515.702956:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271515.702958:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271515.702959:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009a833440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024054976:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271515.702961:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024055232:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271515.702973:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271515.702975:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271515.702977:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013733df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024054784:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271515.702983:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271515.702984:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271515.702986:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009a832f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024054912:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271515.702987:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009a831c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024054848:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271515.703007:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013733c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024054720:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271516.208482:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271517.210496:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271518.212489:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271519.214463:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271519.398450:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024055360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271519.398450:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024055296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271519.398510:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271519.398550:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271519.398567:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055360 00000100:00100000:0.0:1736271519.398578:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055296 00000100:00100000:2.0:1736271519.398635:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5764 00000100:00100000:2.0:1736271519.398641:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb12140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024055360:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271519.398644:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5765 00000100:00100000:0.0:1736271519.398661:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2804c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024055296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271519.398670:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8577856 pending 0 free 3923451904 avail 3691929600 00002000:00000024:0.0:1736271519.398679:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271519.398711:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb12140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024055360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271519.398718:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5764 00000100:00100000:0.0:1736271519.398727:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2804c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024055296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271519.398732:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5765 00000100:00100000:1.0:1736271519.398739:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024055360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271519.398764:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024055296:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1736271520.216489:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271520.476513:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271520.476560:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271520.476585:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271520.476590:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965312 00000100:00100000:0.0:1736271520.476642:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271520.476656:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965440 00000100:00100000:2.0:1736271520.476669:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 170 00000100:00100000:2.0:1736271520.476675:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058965312:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271520.476684:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965376 00000100:00100000:3.0:1736271520.476696:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 636 00000100:00100000:3.0:1736271520.476699:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb12f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058965440:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271520.476723:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271520.476726:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 850 00000100:00100000:1.0:1736271520.476734:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058965376:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:2.0:1736271520.476741:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058965312:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 65us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271520.476741:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb12f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058965440:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 39us (179us total) trans 0 rc 0/0 00010000:02000000:1.0:1736271520.476748:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271520.476748:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 170 00000100:00100000:3.0:1736271520.476748:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 636 00000100:00100000:3.0:1736271520.476790:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965504 00000100:00100000:3.0:1736271520.476813:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965568 00000100:00100000:1.0:1736271520.476821:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058965376:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 88us (236us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271520.476829:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 850 00000100:00100000:3.0:1736271520.476835:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 121027 00000100:00100000:3.0:1736271520.476839:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb117c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1891:x1820604058965504:12345-192.168.203.38@tcp:9:kworker/u8:2.0 00000100:00100000:0.0:1736271520.476840:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 121028 00000100:00100000:0.0:1736271520.476846:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb13900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64bb3b11-afd7-4230-a38c-2a374f07ba02+5:1891:x1820604058965568:12345-192.168.203.38@tcp:9:kworker/u8:2.0 00000020:00000080:0.0:1736271520.476871:0:23098:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xed4dbb87898d470e 00000020:00000080:3.0:1736271520.476872:0:23104:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xed4dbb87898d2ce3 00000100:00080000:0.0:1736271520.476878:0:23098:0:(import.c:86:import_set_state_nolock()) ffff88009c9f5800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000100:00080000:3.0:1736271520.476878:0:23104:0:(import.c:86:import_set_state_nolock()) ffff88008f18f000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000001:00000004:0.0:1736271520.476916:0:23098:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4295015870 00010000:00010000:2.0:1736271520.476916:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1736271520.476916:0:23104:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 20, last_transno is 85899347174 00010000:00010000:2.0:1736271520.476921:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271520.477030:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb13900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64bb3b11-afd7-4230-a38c-2a374f07ba02+2:1891:x1820604058965568:12345-192.168.203.38@tcp:9:kworker/u8:2.0 Request processed in 184us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271520.477030:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb117c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:64bb3b11-afd7-4230-a38c-2a374f07ba02+2:1891:x1820604058965504:12345-192.168.203.38@tcp:9:kworker/u8:2.0 Request processed in 189us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271520.477036:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 121027 00000100:00100000:0.0:1736271520.477040:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 121028 00000100:00080000:2.0:1736271520.710476:0:29989:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271520.710497:0:29989:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271520.710501:0:29989:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271520.710508:0:29989:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8301 00000100:00080000:2.0:1736271520.710512:0:29989:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271520.710519:0:29989:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271520.710525:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024055424:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271520.710542:0:29989:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d5580 x1820604024055488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271520.710575:0:29989:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271520.710578:0:29989:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271520.710579:0:29989:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271520.710581:0:29989:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8301 00000100:00080000:2.0:1736271520.710582:0:29989:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271520.710585:0:29989:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271520.710589:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271520.710592:0:29989:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d2600 x1820604024055616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271520.710601:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024055552:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736271520.710607:0:29989:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271520.710609:0:29989:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271520.710610:0:29989:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271520.710626:0:29989:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8301 00000100:00080000:2.0:1736271520.710628:0:29989:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271520.710630:0:29989:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271520.710638:0:29989:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d2f80 x1820604024055744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271520.710645:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271520.710659:0:29989:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271520.710661:0:29989:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1736271520.710664:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1736271520.710666:0:29989:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271520.710667:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024055808:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271520.710668:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024055872:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736271520.710669:0:29989:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8301 00000100:00080000:2.0:1736271520.710671:0:29989:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:0.0:1736271520.710672:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055552 00000100:00080000:2.0:1736271520.710674:0:29989:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271520.710683:0:29989:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d1c80 x1820604024055936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271520.710686:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271520.710702:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1736271520.710703:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024055680:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736271520.710706:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b287200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024055552:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271520.710707:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055424 00000100:00100000:3.0:1736271520.710718:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271520.710727:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271520.710734:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1736271520.710738:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024055424:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271520.710751:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055872 00000100:00100000:0.0:1736271520.710765:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b287200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024055552:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271520.710771:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055808 00000100:00100000:2.0:1736271520.710776:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024055424:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271520.710781:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1736271520.710781:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6966 00000100:00100000:2.0:1736271520.710782:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1736271520.710784:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b282600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024055872:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736271520.710790:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055680 00000100:00100000:2.0:1736271520.710809:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6967 00000100:00100000:2.0:1736271520.710812:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea676c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024055808:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271520.710812:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b282600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024055872:12345-0@lo:400:kworker/u8:0.0 Request processed in 27us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271520.710818:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024055424:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271520.710818:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6966 00000100:00100000:1.0:1736271520.710823:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:1.0:1736271520.710828:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b284280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024055680:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271520.710833:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea676c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024055808:12345-0@lo:400:kworker/u8:0.0 Request processed in 21us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271520.710836:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6967 00000100:00100000:0.0:1736271520.710843:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024055488:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736271520.710846:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024055872:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271520.710855:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024055552:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736271520.710869:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271520.710879:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b284280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024055680:12345-0@lo:400:kworker/u8:0.0 Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271520.710882:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024055616:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736271520.710886:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:2.0:1736271520.710886:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024055680:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736271520.710896:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271520.710903:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055488 00000100:00100000:1.0:1736271520.710904:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055616 00000100:00100000:0.0:1736271520.710905:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024055744:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736271520.710913:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1736271520.710915:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb11c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024055488:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736271520.710922:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:2.0:1736271520.710924:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271520.710931:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:0.0:1736271520.710932:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024055936:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736271520.710936:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb14c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024055616:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736271520.710945:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb11c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024055488:12345-0@lo:38:kworker/u8:0.0 Request processed in 29us (76us total) trans 0 rc -19/-19 00010000:02000000:1.0:1736271520.710948:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271520.710949:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271520.710949:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055744 00000100:00100000:2.0:1736271520.710950:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1736271520.710959:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024055936 00000100:00100000:3.0:1736271520.710961:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112760 00000100:00100000:3.0:1736271520.710963:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb10e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024055744:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736271520.710967:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271520.710970:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00010000:02000000:3.0:1736271520.710974:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271520.710976:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb14c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024055616:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (77us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271520.710980:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:2.0:1736271520.710982:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb17200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024055936:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736271520.710983:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024055488:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736271520.710983:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00010000:02000000:2.0:1736271520.710989:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1736271520.710997:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271520.710999:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271520.711001:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024055616:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736271520.711003:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb10e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024055744:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (80us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736271520.711009:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736271520.711009:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112760 00000100:00080000:0.0:1736271520.711011:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271520.711013:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024055744:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736271520.711013:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb17200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024055936:12345-0@lo:38:kworker/u8:0.0 Request processed in 30us (64us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271520.711015:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024055808:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271520.711018:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00080000:0.0:1736271520.711020:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271520.711022:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271520.711024:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024055936:0@lo:38:kworker/u8:0.0 00010000:00010000:2.0:1736271521.218470:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271522.221224:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271523.222456:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271524.224440:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271524.406464:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024056000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271524.406483:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024056064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271524.406523:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271524.406552:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271524.406572:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056000 00000100:00100000:3.0:1736271524.406579:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056064 00000100:00100000:3.0:1736271524.406620:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5766 00000100:00100000:3.0:1736271524.406624:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea62f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024056064:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271524.406629:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5767 00000100:00100000:2.0:1736271524.406633:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b281300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024056000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1736271524.406647:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271524.406648:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271524.406681:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea62f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024056064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271524.406687:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b281300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024056000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271524.406688:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5766 00000100:00100000:2.0:1736271524.406693:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5767 00000100:00100000:1.0:1736271524.406700:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024056064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271524.406718:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024056000:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271525.226434:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271525.484537:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271525.484570:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271525.484629:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271525.484659:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965696 00000100:00100000:2.0:1736271525.484673:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965632 00000100:00100000:3.0:1736271525.484692:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965760 00000100:00100000:1.0:1736271525.484694:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 854 00000100:00100000:1.0:1736271525.484700:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb15580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058965696:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:2.0:1736271525.484700:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 172 00000100:00100000:2.0:1736271525.484703:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058965632:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00010000:02000000:1.0:1736271525.484713:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271525.484722:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 639 00000100:00100000:3.0:1736271525.484726:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb150c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058965760:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271525.484743:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058965632:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 40us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271525.484745:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb15580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058965696:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 46us (174us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271525.484748:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 172 00000100:00100000:1.0:1736271525.484751:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 854 00000100:00100000:3.0:1736271525.484758:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb150c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058965760:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 31us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271525.484764:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 639 00000100:00080000:2.0:1736271525.718449:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271525.718456:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271525.718460:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271525.718467:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8306 00000100:00100000:0.0:1736271525.718474:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024056128:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271525.718484:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271525.718490:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271525.718510:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d6d40 x1820604024056192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271525.718538:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271525.718557:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271525.718560:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271525.718562:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271525.718563:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024056192:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271525.718564:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8306 00000100:00080000:2.0:1736271525.718566:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271525.718570:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271525.718601:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d3900 x1820604024056320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271525.718602:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271525.718615:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024056256:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271525.718616:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271525.718619:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271525.718620:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024056320:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271525.718620:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271525.718623:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8306 00000100:00080000:2.0:1736271525.718625:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271525.718628:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271525.718632:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024056384:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271525.718637:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271525.718638:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d4740 x1820604024056448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271525.718658:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056192 00000100:00100000:0.0:1736271525.718660:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271525.718665:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271525.718667:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271525.718668:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271525.718670:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8306 00000100:00080000:2.0:1736271525.718671:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1736271525.718677:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024056448:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271525.718678:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271525.718679:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056256 00000100:00100000:2.0:1736271525.718685:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d7200 x1820604024056640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271525.718693:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271525.718695:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056320 00000100:00100000:0.0:1736271525.718701:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271525.718715:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056384 00000100:00100000:2.0:1736271525.718719:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:2.0:1736271525.718723:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb13dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024056256:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271525.718726:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:1.0:1736271525.718730:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b282ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024056384:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271525.718732:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024056640:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271525.718755:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271525.718757:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1736271525.718762:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea64280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024056192:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271525.718770:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb13dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024056256:12345-0@lo:400:kworker/u8:2.0 Request processed in 46us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271525.718771:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024056576:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271525.718773:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b282ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024056384:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271525.718775:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:1.0:1736271525.718779:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00010000:02000000:3.0:1736271525.718784:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271525.718787:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271525.718788:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056640 00000100:00100000:1.0:1736271525.718791:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1736271525.718794:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb10980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024056320:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271525.718796:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:0.0:1736271525.718797:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736271525.718798:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024056640:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271525.718801:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024056512:0@lo:400:kworker/u8:2.0 00010000:02000000:1.0:1736271525.718804:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736271525.718804:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271525.718818:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271525.718818:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea64280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024056192:12345-0@lo:38:kworker/u8:2.0 Request processed in 56us (216us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271525.718823:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:2.0:1736271525.718838:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024056640:12345-0@lo:38:kworker/u8:2.0 Request processed in 38us (82us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271525.718840:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb10980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024056320:12345-0@lo:38:kworker/u8:2.0 Request processed in 44us (179us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271525.718842:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:1.0:1736271525.718846:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:0.0:1736271525.718847:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056576 00000100:00100000:3.0:1736271525.718847:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056448 00000100:00100000:2.0:1736271525.718854:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056512 00000100:00100000:3.0:1736271525.718862:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112761 00000100:00100000:3.0:1736271525.718864:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb12600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024056448:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271525.718865:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6968 00000100:00100000:1.0:1736271525.718868:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056128 00000100:00100000:2.0:1736271525.718868:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb13440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024056512:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:3.0:1736271525.718868:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271525.718872:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6969 00000100:00100000:0.0:1736271525.718875:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb11300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024056576:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271525.718883:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb12600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024056448:12345-0@lo:38:kworker/u8:2.0 Request processed in 18us (182us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271525.718886:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112761 00000100:00100000:2.0:1736271525.718887:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb13440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024056512:12345-0@lo:400:kworker/u8:2.0 Request processed in 19us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271525.718889:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1736271525.718891:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6968 00000100:00100000:1.0:1736271525.718893:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024056128:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271525.718898:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb11300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024056576:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271525.718903:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6969 00000100:00100000:3.0:1736271525.718912:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024056384:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271525.718914:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024056256:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271525.718921:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024056128:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271525.718926:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1736271525.718938:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024056512:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271525.718938:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271525.718940:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271525.718942:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024056640:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271525.718943:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024056576:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271525.718949:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024056128:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271525.718949:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271525.718951:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271525.718952:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024056448:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271525.718959:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271525.718960:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271525.718962:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024056320:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271525.718967:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271525.718968:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271525.718969:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024056192:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271526.228491:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1736271526.375096:0:10487:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64bb3b11-afd7-4230-a38c-2a374f07ba02 00000020:00000080:0.0:1736271526.375120:0:10487:0:(genops.c:985:class_export_put()) final put ffff88009c9f6000/64bb3b11-afd7-4230-a38c-2a374f07ba02 00000001:00100000:1.0:1736271526.375147:0:25514:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 64bb3b11-afd7-4230-a38c-2a374f07ba02 00000020:00000080:1.0:1736271526.375152:0:25514:0:(genops.c:985:class_export_put()) final put ffff88008f18d000/64bb3b11-afd7-4230-a38c-2a374f07ba02 00000020:00000080:2.0:1736271526.375161:0:19360:0:(genops.c:944:class_export_destroy()) destroying export ffff88009c9f6000/64bb3b11-afd7-4230-a38c-2a374f07ba02 for lustre-OST0001 00000020:00000080:2.0:1736271526.375191:0:19360:0:(genops.c:944:class_export_destroy()) destroying export ffff88008f18d000/64bb3b11-afd7-4230-a38c-2a374f07ba02 for lustre-OST0000 00000020:00000080:2.0:1736271526.375207:0:19360:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88009c9f5800 for lustre-OST0001 00000020:00000080:2.0:1736271526.375211:0:19360:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88008f18f000 for lustre-OST0000 00010000:00010000:1.0:1736271527.230502:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271528.232464:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271529.234478:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271529.414448:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024056704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271529.414448:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024056768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271529.414510:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271529.414536:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271529.414571:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056768 00000100:00100000:3.0:1736271529.414582:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056704 00000100:00100000:3.0:1736271529.414615:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5768 00000100:00100000:3.0:1736271529.414620:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea63dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024056704:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271529.414624:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5769 00000100:00100000:2.0:1736271529.414628:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b282140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024056768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271529.414647:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:3.0:1736271529.414647:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736271529.414677:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea63dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024056704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271529.414684:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5768 00000100:00100000:2.0:1736271529.414690:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b282140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024056768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271529.414696:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5769 00000100:00100000:1.0:1736271529.414704:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024056704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271529.414714:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024056768:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271530.236470:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271530.492509:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271530.492584:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271530.492605:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965824 00000100:00100000:0.0:1736271530.492622:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271530.492640:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965952 00000100:00100000:0.0:1736271530.492642:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058965888 00000100:00100000:2.0:1736271530.492652:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 174 00000100:00100000:0.0:1736271530.492659:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 858 00000100:00100000:2.0:1736271530.492659:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058965824:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271530.492662:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb14740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058965888:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:1.0:1736271530.492673:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 642 00010000:02000000:0.0:1736271530.492675:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271530.492676:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb104c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058965952:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271530.492708:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb14740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058965888:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 45us (86us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271530.492709:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058965824:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 51us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271530.492711:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb104c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058965952:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 35us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271530.492713:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 858 00000100:00100000:2.0:1736271530.492714:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 174 00000100:00100000:1.0:1736271530.492715:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 642 00000100:00080000:1.0:1736271530.726488:0:29989:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271530.726495:0:29989:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271530.726499:0:29989:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271530.726506:0:29989:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8311 00000100:00100000:2.0:1736271530.726508:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024056832:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736271530.726510:0:29989:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1736271530.726516:0:29989:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271530.726541:0:29989:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea60000 x1820604024056896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1736271530.726588:0:29989:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271530.726592:0:29989:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271530.726593:0:29989:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271530.726596:0:29989:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8311 00000100:00080000:1.0:1736271530.726597:0:29989:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1736271530.726600:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024056896:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736271530.726601:0:29989:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271530.726603:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271530.726611:0:29989:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea62ac0 x1820604024057024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271530.726635:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736271530.726636:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271530.726640:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024056960:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736271530.726645:0:29989:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271530.726648:0:29989:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271530.726650:0:29989:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271530.726652:0:29989:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8311 00000100:00100000:3.0:1736271530.726655:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024057024:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736271530.726657:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736271530.726666:0:29989:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1736271530.726670:0:29989:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271530.726677:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271530.726682:0:29989:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea64740 x1820604024057152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271530.726690:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024057152:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736271530.726698:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056896 00000100:00100000:2.0:1736271530.726698:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056832 00000100:00080000:1.0:1736271530.726700:0:29989:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271530.726702:0:29989:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271530.726703:0:29989:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271530.726705:0:29989:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8311 00000100:00080000:1.0:1736271530.726706:0:29989:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1736271530.726708:0:29989:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271530.726709:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271530.726713:0:29989:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea62600 x1820604024057344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271530.726721:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024057344:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736271530.726724:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024056960 00000100:00100000:2.0:1736271530.726732:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1736271530.726734:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024057216:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271530.726736:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271530.726737:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024056832:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736271530.726744:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057024 00000100:00100000:0.0:1736271530.726750:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057344 00000100:00100000:0.0:1736271530.726757:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1736271530.726758:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271530.726760:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057152 00000100:00100000:0.0:1736271530.726761:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024056960:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736271530.726772:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736271530.726773:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024056832:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271530.726774:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea63900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024057088:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271530.726776:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112762 00000100:00100000:2.0:1736271530.726779:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1736271530.726779:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b281c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024057152:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736271530.726787:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1736271530.726791:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271530.726802:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057216 00000100:00100000:0.0:1736271530.726808:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024056960:12345-0@lo:400:kworker/u8:0.0 Request processed in 47us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271530.726811:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057088 00000100:00100000:0.0:1736271530.726814:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1736271530.726820:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6970 00000100:00100000:1.0:1736271530.726822:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea64c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024057216:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271530.726825:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b281c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024057152:12345-0@lo:38:kworker/u8:0.0 Request processed in 44us (115us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271530.726826:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1736271530.726829:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea60e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024057088:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736271530.726832:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:0.0:1736271530.726834:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2817c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024056896:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736271530.726839:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112762 00010000:02000000:0.0:1736271530.726840:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271530.726843:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea64c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024057216:12345-0@lo:400:kworker/u8:0.0 Request processed in 21us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271530.726847:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6970 00000100:00100000:2.0:1736271530.726852:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea60e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024057088:12345-0@lo:400:kworker/u8:0.0 Request processed in 23us (64us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271530.726856:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:0.0:1736271530.726858:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2817c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024056896:12345-0@lo:38:kworker/u8:0.0 Request processed in 23us (222us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271530.726859:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:3.0:1736271530.726859:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b280e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024057024:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736271530.726863:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:2.0:1736271530.726866:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00010000:02000000:3.0:1736271530.726866:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271530.726869:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b286880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024057344:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736271530.726871:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea63900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024057088:0@lo:400:kworker/u8:0.0 00010000:02000000:2.0:1736271530.726873:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271530.726876:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024057216:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271530.726884:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b280e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024057024:12345-0@lo:38:kworker/u8:0.0 Request processed in 24us (207us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271530.726885:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b286880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024057344:12345-0@lo:38:kworker/u8:0.0 Request processed in 16us (149us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271530.726889:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:2.0:1736271530.726891:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:3.0:1736271530.726899:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736271530.726905:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024057280:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271530.726909:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024056960:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736271530.726915:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024056832:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736271530.726925:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736271530.726959:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271530.726962:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271530.726964:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024057344:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736271530.726970:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057280 00000100:00080000:3.0:1736271530.726970:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271530.726971:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271530.726973:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024057152:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736271530.726978:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271530.726980:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271530.726982:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024057024:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736271530.726987:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271530.726988:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271530.726990:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024056896:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736271530.726994:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6971 00000100:00100000:1.0:1736271530.726997:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b284740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024057280:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736271530.727026:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b284740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024057280:12345-0@lo:400:kworker/u8:0.0 Request processed in 29us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271530.727031:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6971 00000100:00100000:3.0:1736271530.727037:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024057280:0@lo:400:kworker/u8:0.0 00010000:00010000:2.0:1736271531.238489:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:0.0:1736271531.545375:0:19949:0:(genops.c:1786:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 16 seconds. The obd refcount = 4. Is it stuck? 00000020:02000400:0.0:1736271531.548522:0:19949:0:(genops.c:1752:print_export_data()) lustre-MDT0000: UNLINKED ffff88008faa8000 64bb3b11-afd7-4230-a38c-2a374f07ba02 192.168.203.38@tcp 1 (0 0 0) 1 0 1 0: (null) 523986010115 stale:0 00010000:00010000:1.0:1736271532.240471:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271533.242522:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271534.244466:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271534.422442:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024057408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271534.422484:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024057472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271534.422503:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271534.422557:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271534.422573:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057408 00000100:00100000:2.0:1736271534.422607:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057472 00000100:00100000:2.0:1736271534.422623:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5770 00000100:00100000:2.0:1736271534.422627:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2850c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024057408:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271534.422643:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5771 00000100:00100000:3.0:1736271534.422649:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea63900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024057472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271534.422656:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:3.0:1736271534.422674:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271534.422706:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea63900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024057472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271534.422712:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5771 00000100:00100000:2.0:1736271534.422716:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2850c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024057408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271534.422727:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5770 00000100:00100000:1.0:1736271534.422735:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024057472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271534.422757:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024057408:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271535.246443:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271535.500550:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271535.500597:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271535.500642:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966016 00000100:00100000:0.0:1736271535.500650:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271535.500679:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966080 00000100:00100000:2.0:1736271535.500692:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 176 00000100:00100000:2.0:1736271535.500697:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058966016:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271535.500709:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966144 00000100:00100000:3.0:1736271535.500716:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 862 00000100:00100000:3.0:1736271535.500723:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb16880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058966080:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:1.0:1736271535.500727:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 645 00000100:00100000:1.0:1736271535.500730:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a832140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058966144:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00010000:02000000:3.0:1736271535.500740:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271535.500756:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058966016:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 59us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271535.500761:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 176 00000100:00100000:1.0:1736271535.500771:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a832140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058966144:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 41us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271535.500776:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 645 00000100:00100000:3.0:1736271535.500777:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb16880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058966080:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 54us (180us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271535.500783:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 862 00000100:00080000:2.0:1736271535.734508:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271535.734530:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271535.734533:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271535.734539:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8316 00000100:00080000:2.0:1736271535.734542:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271535.734546:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271535.734563:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0e40 x1820604024057600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271535.734573:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024057536:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271535.734600:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271535.734602:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271535.734603:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271535.734606:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8316 00000100:00080000:2.0:1736271535.734607:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00100000:1.0:1736271535.734608:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024057664:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271535.734610:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271535.734629:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d6d40 x1820604024057728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271535.734629:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024057600:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271535.734642:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271535.734644:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271535.734645:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736271535.734646:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271535.734647:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8316 00000100:00080000:2.0:1736271535.734648:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00100000:1.0:1736271535.734651:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271535.734651:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271535.734658:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d4740 x1820604024057856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271535.734677:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271535.734679:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271535.734680:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271535.734682:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8316 00000100:00080000:2.0:1736271535.734683:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00100000:1.0:1736271535.734685:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1736271535.734685:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271535.734686:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024057984:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271535.734686:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057664 00000100:00100000:1.0:1736271535.734691:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024057792:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271535.734692:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d5f00 x1820604024058048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271535.734712:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271535.734713:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271535.734723:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057792 00000100:00100000:0.0:1736271535.734731:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736271535.734732:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271535.734736:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:0.0:1736271535.734737:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024057920:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271535.734740:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057600 00000100:00100000:2.0:1736271535.734742:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea65580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024057664:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271535.734749:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1736271535.734752:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024057728:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271535.734753:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea62140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024057792:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271535.734755:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271535.734786:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057984 00000100:00100000:1.0:1736271535.734790:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271535.734798:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea62140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024057792:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271535.734802:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea65580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024057664:12345-0@lo:400:kworker/u8:2.0 Request processed in 61us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271535.734802:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1736271535.734803:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024057856:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271535.734806:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1736271535.734812:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057728 00000100:00100000:0.0:1736271535.734817:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057920 00000100:00100000:3.0:1736271535.734817:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:1.0:1736271535.734822:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271535.734825:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1736271535.734826:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea63440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024057600:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271535.734828:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea61300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024057728:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271535.734832:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6972 00000100:00100000:1.0:1736271535.734833:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024058048:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271535.734836:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a835a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024057984:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:3.0:1736271535.734837:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736271535.734843:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271535.734848:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271535.734870:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058048 00000100:00100000:3.0:1736271535.734872:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea63440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024057600:12345-0@lo:38:kworker/u8:2.0 Request processed in 46us (139us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271535.734878:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a835a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024057984:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271535.734878:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea61300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024057728:12345-0@lo:38:kworker/u8:2.0 Request processed in 48us (86us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271535.734879:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1736271535.734882:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:0.0:1736271535.734885:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6972 00000100:00100000:1.0:1736271535.734887:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1736271535.734891:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024058048:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271535.734898:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271535.734899:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6973 00000100:00100000:2.0:1736271535.734903:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a8350c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024057920:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271535.734908:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057536 00000100:00100000:0.0:1736271535.734914:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024057856 00000100:00100000:1.0:1736271535.734920:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024058048:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (71us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271535.734923:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a8350c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024057920:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271535.734925:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:3.0:1736271535.734925:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1736271535.734927:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6973 00000100:00100000:3.0:1736271535.734928:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024057536:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271535.734929:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112763 00000100:00100000:0.0:1736271535.734933:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea60980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024057856:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271535.734940:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271535.734948:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024057536:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271535.734951:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1736271535.734957:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024057792:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271535.734961:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea60980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024057856:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (140us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271535.734965:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112763 00000100:00100000:1.0:1736271535.734969:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024057664:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271535.734996:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024057920:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271535.735000:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271535.735002:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024057984:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271535.735003:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271535.735005:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024057728:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271535.735007:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024057536:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271535.735013:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271535.735015:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271535.735017:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024057856:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271535.735023:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271535.735025:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271535.735027:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024058048:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271535.735045:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271535.735047:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271535.735049:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024057600:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271536.248469:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271537.250469:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271538.252561:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271539.254434:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271539.430413:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009a835580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024058112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271539.430460:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024058176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271539.430473:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271539.430530:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271539.430531:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058112 00000100:00100000:2.0:1736271539.430567:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058176 00000100:00100000:1.0:1736271539.430580:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5772 00000100:00100000:1.0:1736271539.430587:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea67200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024058112:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271539.430593:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5773 00000100:00100000:2.0:1736271539.430598:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a832600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024058176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736271539.430620:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271539.430621:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271539.430661:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a832600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024058176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271539.430664:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea67200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024058112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271539.430668:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5773 00000100:00100000:1.0:1736271539.430673:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5772 00000100:00100000:0.0:1736271539.430681:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024058176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271539.430717:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009a835580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024058112:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271540.256433:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271540.508471:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271540.508550:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271540.508582:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966208 00000100:00100000:1.0:1736271540.508614:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966336 00000100:00100000:2.0:1736271540.508632:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 178 00000100:00100000:0.0:1736271540.508633:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271540.508638:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058966208:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271540.508641:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966272 00000100:00100000:1.0:1736271540.508651:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 648 00000100:00100000:1.0:1736271540.508654:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a836880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058966336:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271540.508666:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 866 00000100:00100000:0.0:1736271540.508671:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a837200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058966272:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271540.508682:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271540.508689:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a836880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058966336:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 35us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271540.508694:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 648 00000100:00100000:2.0:1736271540.508696:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058966208:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 57us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271540.508702:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 178 00000100:00100000:0.0:1736271540.508703:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a837200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058966272:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 32us (71us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271540.508709:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 866 00000100:00080000:2.0:1736271540.742434:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271540.742439:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271540.742441:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271540.742445:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8321 00000100:00080000:2.0:1736271540.742448:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271540.742451:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271540.742466:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d2600 x1820604024058304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271540.742474:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024058240:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271540.742496:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271540.742498:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271540.742499:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271540.742501:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8321 00000100:00080000:2.0:1736271540.742502:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271540.742505:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271540.742510:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d4c00 x1820604024058432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271540.742515:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024058368:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271540.742533:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271540.742535:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271540.742536:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271540.742538:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8321 00000100:00080000:2.0:1736271540.742539:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271540.742540:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271540.742545:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d2ac0 x1820604024058560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271540.742555:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271540.742556:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271540.742556:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271540.742567:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271540.742568:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271540.742570:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8321 00000100:00080000:2.0:1736271540.742571:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271540.742572:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271540.742579:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d6880 x1820604024058752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271540.742579:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024058624:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271540.742581:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024058688:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271540.742597:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058368 00000100:00100000:2.0:1736271540.742597:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058240 00000100:00100000:1.0:1736271540.742610:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271540.742620:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1736271540.742622:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1736271540.742625:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a8317c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024058368:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271540.742625:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024058240:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271540.742629:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058688 00000100:00100000:1.0:1736271540.742642:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024058496:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271540.742651:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6974 00000100:00100000:3.0:1736271540.742655:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea66880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024058688:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271540.742659:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a8317c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024058368:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271540.742662:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271540.742665:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1736271540.742668:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024058240:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271540.742674:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1736271540.742683:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058496 00000100:00100000:3.0:1736271540.742686:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea66880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024058688:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (76us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271540.742691:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6974 00000100:00100000:0.0:1736271540.742694:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:0.0:1736271540.742696:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea650c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024058496:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271540.742697:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024058688:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271540.742705:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024058240:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271540.742707:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271540.742722:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058624 00000100:00100000:0.0:1736271540.742733:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea650c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024058496:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (70us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271540.742734:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6975 00000100:00100000:1.0:1736271540.742736:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024058496:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271540.742736:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2876c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024058624:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271540.742738:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:0.0:1736271540.742757:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024058368:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271540.742768:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2876c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024058624:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271540.742769:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024058304:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271540.742771:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6975 00000100:00100000:0.0:1736271540.742791:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271540.742793:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024058624:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271540.742809:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024058432:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271540.742824:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271540.742826:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058304 00000100:00100000:1.0:1736271540.742840:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058432 00000100:00100000:0.0:1736271540.742841:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024058560:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271540.742848:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:3.0:1736271540.742851:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a832ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024058304:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271540.742852:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1736271540.742855:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a8304c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024058432:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271540.742858:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:1.0:1736271540.742861:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736271540.742861:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271540.742868:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024058752:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271540.742880:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a8304c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024058432:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (56us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271540.742881:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058560 00000100:00100000:0.0:1736271540.742884:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271540.742884:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a832ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024058304:12345-0@lo:38:kworker/u8:2.0 Request processed in 32us (92us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271540.742886:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1736271540.742894:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058752 00000100:00100000:2.0:1736271540.742896:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112764 00000100:00100000:3.0:1736271540.742897:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1736271540.742899:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a833900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024058560:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271540.742900:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271540.742902:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271540.742905:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024058304:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271540.742905:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00010000:02000000:2.0:1736271540.742905:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271540.742907:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a8363c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024058752:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271540.742911:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:02000000:1.0:1736271540.742912:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1736271540.742913:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271540.742915:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024058432:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271540.742928:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a833900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024058560:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (69us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271540.742931:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a8363c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024058752:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (47us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736271540.742932:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271540.742933:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271540.742933:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112764 00000100:00100000:1.0:1736271540.742936:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1736271540.742939:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024058560:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271540.742948:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271540.742950:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271540.742951:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024058752:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271541.258516:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271542.260439:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271543.262447:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271544.264451:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271544.438426:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009a830e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024058816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271544.438525:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271544.438553:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024058880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271544.438572:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058816 00000100:00100000:0.0:1736271544.438579:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271544.438609:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058880 00000100:00100000:0.0:1736271544.438619:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5774 00000100:00100000:2.0:1736271544.438664:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5775 00000100:00100000:2.0:1736271544.438667:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a8376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024058880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271544.438691:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271544.438708:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea65f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024058816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271544.438724:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271544.438729:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a8376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024058880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271544.438735:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5775 00000100:00100000:0.0:1736271544.438753:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea65f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024058816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271544.438760:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5774 00000100:00100000:0.0:1736271544.438795:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024058880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271544.438878:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009a830e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024058816:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271545.266447:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271545.516607:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271545.516656:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271545.516689:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966400 00000100:00100000:0.0:1736271545.516704:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271545.516731:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966464 00000100:00100000:0.0:1736271545.516742:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966528 00000100:00100000:2.0:1736271545.516745:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:2.0:1736271545.516748:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058966400:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271545.516763:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 651 00000100:00100000:1.0:1736271545.516768:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058966528:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271545.516769:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 870 00000100:00100000:0.0:1736271545.516773:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a835f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058966464:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271545.516788:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271545.516802:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058966400:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 53us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271545.516806:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:0.0:1736271545.516819:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a835f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058966464:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 46us (164us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271545.516821:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058966528:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 52us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271545.516824:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 870 00000100:00100000:1.0:1736271545.516828:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 651 00000100:00080000:2.0:1736271545.750428:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271545.750435:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271545.750438:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271545.750443:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8326 00000100:00080000:2.0:1736271545.750460:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271545.750465:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271545.750472:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024058944:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271545.750488:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d5a40 x1820604024059008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271545.750522:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024059008:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271545.750530:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271545.750530:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271545.750542:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271545.750544:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271545.750547:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8326 00000100:00080000:2.0:1736271545.750549:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271545.750552:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271545.750562:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d2ac0 x1820604024059136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271545.750570:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024059072:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271545.750576:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024058944 00000100:00080000:2.0:1736271545.750577:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271545.750580:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271545.750580:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271545.750583:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8326 00000100:00080000:2.0:1736271545.750584:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:0.0:1736271545.750585:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271545.750587:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271545.750595:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d2600 x1820604024059264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271545.750597:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1736271545.750598:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024059200:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271545.750600:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024058944:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271545.750618:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271545.750618:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736271545.750620:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024059136:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271545.750621:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271545.750622:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271545.750624:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8326 00000100:00100000:3.0:1736271545.750625:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024058944:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (95us total) trans 0 rc 0/0 00000100:00080000:2.0:1736271545.750626:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271545.750628:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271545.750629:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1736271545.750633:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271545.750636:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0000 x1820604024059456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271545.750641:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024059264:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271545.750645:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271545.750656:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271545.750656:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024059328:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271545.750657:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024059392:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271545.750666:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024059456:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271545.750677:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059008 00000100:00100000:3.0:1736271545.750680:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271545.750683:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271545.750696:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059264 00000100:00100000:0.0:1736271545.750707:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059200 00000100:00100000:1.0:1736271545.750707:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059136 00000100:00100000:1.0:1736271545.750714:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059072 00000100:00100000:3.0:1736271545.750722:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024058944:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271545.750723:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112765 00000100:00100000:0.0:1736271545.750724:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059456 00000100:00100000:2.0:1736271545.750727:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a834c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024059264:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271545.750729:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:0.0:1736271545.750734:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1736271545.750734:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024059200:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271545.750738:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea62ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024059072:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:2.0:1736271545.750738:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271545.750749:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:3.0:1736271545.750751:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a834280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024059008:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271545.750757:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271545.750775:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea62ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024059072:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271545.750779:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:2.0:1736271545.750779:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a834c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024059264:12345-0@lo:38:kworker/u8:2.0 Request processed in 51us (121us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271545.750781:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a834280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024059008:12345-0@lo:38:kworker/u8:2.0 Request processed in 30us (197us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271545.750785:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112765 00000100:00100000:3.0:1736271545.750785:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1736271545.750789:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024059200:12345-0@lo:400:kworker/u8:2.0 Request processed in 54us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271545.750792:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:0.0:1736271545.750793:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a834740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024059136:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271545.750795:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1736271545.750799:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00010000:02000000:0.0:1736271545.750801:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271545.750803:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a830980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024059456:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271545.750804:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059392 00010000:02000000:3.0:1736271545.750808:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271545.750814:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a834740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024059136:12345-0@lo:38:kworker/u8:2.0 Request processed in 20us (180us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271545.750817:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:2.0:1736271545.750823:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6976 00000100:00100000:2.0:1736271545.750826:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b280980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024059392:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271545.750827:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024059072:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271545.750828:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a830980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024059456:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (144us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271545.750833:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00080000:0.0:1736271545.750835:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271545.750837:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271545.750839:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024059456:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271545.750844:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271545.750845:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271545.750850:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024059200:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271545.750851:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024059136:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271545.750857:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b280980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024059392:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (177us total) trans 0 rc 0/0 00000100:00080000:0.0:1736271545.750859:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271545.750861:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271545.750862:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024059264:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271545.750863:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6976 00000100:00080000:0.0:1736271545.750868:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271545.750870:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271545.750871:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024059008:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271545.750872:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024059392:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271545.750889:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271545.750909:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059328 00000100:00100000:3.0:1736271545.750920:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6977 00000100:00100000:3.0:1736271545.750923:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d2f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024059328:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271545.750948:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d2f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024059328:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (60us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271545.750952:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6977 00000100:00100000:2.0:1736271545.750977:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024059328:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271546.268492:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271547.270498:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271548.272505:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271549.274472:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271549.446394:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009a833dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024059520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271549.446484:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271549.446519:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271549.446524:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024059584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271549.446536:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271549.446548:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059520 00000100:00100000:0.0:1736271549.446563:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059584 00000100:00100000:3.0:1736271549.446582:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5776 00000100:00100000:3.0:1736271549.446586:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea64740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024059520:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271549.446603:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5777 00002000:00000024:3.0:1736271549.446605:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271549.446606:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea62600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024059584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271549.446628:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271549.446640:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea64740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024059520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271549.446644:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5776 00000100:00100000:1.0:1736271549.446674:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009a833dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024059520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271549.446678:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea62600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024059584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271549.446684:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5777 00000100:00100000:1.0:1736271549.446697:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024059584:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271550.276463:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271550.524542:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271550.524588:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271550.524625:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966592 00000100:00100000:0.0:1736271550.524635:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271550.524660:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966720 00000100:00100000:0.0:1736271550.524672:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966656 00000100:00100000:2.0:1736271550.524679:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:2.0:1736271550.524685:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058966592:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271550.524694:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 654 00000100:00100000:0.0:1736271550.524699:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 874 00000100:00100000:1.0:1736271550.524699:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a831300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058966720:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271550.524703:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a832f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058966656:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271550.524717:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271550.524754:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058966592:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 68us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271550.524755:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a831300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058966720:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 55us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271550.524756:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a832f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058966656:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 54us (123us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271550.524761:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 654 00000100:00100000:2.0:1736271550.524761:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:0.0:1736271550.524764:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 874 00000100:00080000:2.0:1736271550.758513:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271550.758520:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271550.758524:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271550.758545:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8331 00000100:00080000:2.0:1736271550.758550:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271550.758557:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271550.758572:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024059648:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271550.758580:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d1c80 x1820604024059712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271550.758619:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271550.758622:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271550.758624:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271550.758627:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8331 00000100:00080000:2.0:1736271550.758628:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271550.758632:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271550.758642:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d5f00 x1820604024059840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271550.758648:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024059776:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271550.758650:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271550.758654:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024059712:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271550.758665:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271550.758668:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271550.758669:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271550.758672:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8331 00000100:00080000:2.0:1736271550.758674:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271550.758677:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271550.758686:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d6d40 x1820604024059968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271550.758704:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271550.758714:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024060032:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271550.758714:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271550.758718:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271550.758719:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271550.758722:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8331 00000100:00100000:1.0:1736271550.758726:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024059840:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271550.758728:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:3.0:1736271550.758728:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059648 00000100:00080000:2.0:1736271550.758731:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271550.758739:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271550.758741:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d7200 x1820604024060160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271550.758746:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271550.758756:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271550.758762:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024059904:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271550.758763:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1736271550.758764:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024059968:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271550.758765:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060032 00000100:00100000:3.0:1736271550.758769:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024059648:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271550.758785:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271550.758785:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271550.758799:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024060160:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271550.758816:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271550.758816:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024059648:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271550.758820:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059712 00000100:00100000:3.0:1736271550.758822:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1736271550.758841:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059840 00000100:00100000:1.0:1736271550.758845:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059904 00000100:00100000:0.0:1736271550.758853:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060160 00000100:00100000:2.0:1736271550.758861:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6978 00000100:00100000:3.0:1736271550.758863:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059968 00000100:00100000:0.0:1736271550.758864:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:2.0:1736271550.758866:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a831c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024060032:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271550.758870:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a833440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024059904:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271550.758870:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1736271550.758874:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea663c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024059712:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271550.758877:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112766 00000100:00100000:3.0:1736271550.758879:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024059968:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271550.758887:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736271550.758887:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271550.758902:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a831c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024060032:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271550.758907:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6978 00000100:00100000:0.0:1736271550.758916:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a833440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024059904:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271550.758922:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1736271550.758927:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024059968:12345-0@lo:38:kworker/u8:2.0 Request processed in 47us (142us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271550.758928:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea663c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024059712:12345-0@lo:38:kworker/u8:2.0 Request processed in 54us (225us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271550.758932:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112766 00000100:00100000:1.0:1736271550.758934:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1736271550.758939:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:0.0:1736271550.758942:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea61c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024059840:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271550.758950:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271550.758951:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024059904:0@lo:400:kworker/u8:2.0 00010000:02000000:0.0:1736271550.758952:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271550.758952:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:1.0:1736271550.758955:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024060160:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271550.758961:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024060032:0@lo:400:kworker/u8:2.0 00010000:02000000:1.0:1736271550.758962:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271550.758962:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736271550.758966:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024060096:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271550.758976:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea61c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024059840:12345-0@lo:38:kworker/u8:2.0 Request processed in 33us (229us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271550.758981:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1736271550.758984:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024060160:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (168us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271550.758986:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271550.758990:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024059776 00000100:00100000:1.0:1736271550.758990:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:2.0:1736271550.758997:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060096 00000100:00100000:0.0:1736271550.759012:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:2.0:1736271550.759012:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6979 00000100:00100000:2.0:1736271550.759015:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b285580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024060096:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271550.759016:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b285a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024059776:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271550.759054:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b285580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024060096:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271550.759055:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b285a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024059776:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271550.759060:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6979 00000100:00100000:0.0:1736271550.759061:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1736271550.759062:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024060096:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271550.759072:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024059776:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271550.759079:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271550.759081:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271550.759083:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024059968:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271550.759093:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271550.759095:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271550.759096:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024060160:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271550.759098:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024059648:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271550.759111:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271550.759113:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271550.759115:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024059712:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271550.759121:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271550.759123:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271550.759124:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024059840:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271551.278397:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271552.280434:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271553.282507:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271554.284426:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271554.454499:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271554.454506:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271554.454519:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009a833dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024060288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271554.454519:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013733b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024060224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271554.454571:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271554.454602:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060224 00000100:00100000:2.0:1736271554.454630:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271554.454649:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060288 00000100:00100000:0.0:1736271554.454684:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5778 00000100:00100000:0.0:1736271554.454689:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024060224:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271554.454694:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5779 00000100:00100000:2.0:1736271554.454699:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024060288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271554.454718:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271554.454718:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271554.454756:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024060224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271554.454758:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024060288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271554.454763:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5778 00000100:00100000:2.0:1736271554.454766:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5779 00000100:00100000:1.0:1736271554.454775:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013733b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024060224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271554.454809:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009a833dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024060288:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271555.286460:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271555.532545:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271555.532590:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271555.532628:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271555.532628:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966784 00000100:00100000:0.0:1736271555.532648:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966912 00000100:00100000:1.0:1736271555.532655:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966848 00000100:00100000:0.0:1736271555.532680:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 657 00000100:00100000:2.0:1736271555.532681:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 184 00000100:00100000:0.0:1736271555.532684:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a830e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058966912:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271555.532686:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058966784:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271555.532688:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 878 00000100:00100000:1.0:1736271555.532691:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a835580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058966848:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271555.532701:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271555.532726:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a830e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058966912:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271555.532730:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 657 00000100:00100000:2.0:1736271555.532730:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058966784:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 43us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271555.532736:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a835580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058966848:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 43us (107us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271555.532737:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 184 00000100:00100000:1.0:1736271555.532742:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 878 00000100:00080000:2.0:1736271555.766474:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271555.766480:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271555.766492:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271555.766498:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8336 00000100:00080000:2.0:1736271555.766502:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271555.766506:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271555.766509:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024060352:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271555.766525:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d7200 x1820604024060416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271555.766567:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024060416:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271555.766567:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271555.766571:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271555.766572:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271555.766575:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8336 00000100:00100000:3.0:1736271555.766576:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271555.766577:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271555.766580:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271555.766588:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d63c0 x1820604024060544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271555.766602:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271555.766604:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271555.766605:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736271555.766607:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271555.766608:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8336 00000100:00100000:1.0:1736271555.766609:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024060480:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271555.766610:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271555.766612:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271555.766615:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024060608:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271555.766619:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d3dc0 x1820604024060672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271555.766628:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024060544:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271555.766640:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271555.766641:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271555.766643:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1736271555.766644:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024060736:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271555.766644:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271555.766644:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024060800:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271555.766646:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8336 00000100:00080000:2.0:1736271555.766652:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271555.766655:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271555.766663:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0e40 x1820604024060864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271555.766667:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271555.766667:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271555.766675:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024060672:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271555.766675:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060416 00000100:00100000:0.0:1736271555.766686:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271555.766686:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060352 00000100:00100000:3.0:1736271555.766691:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060800 00000100:00100000:1.0:1736271555.766695:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060480 00000100:00100000:0.0:1736271555.766696:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024060864:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271555.766705:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271555.766709:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060544 00000100:00100000:2.0:1736271555.766710:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1736271555.766711:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6980 00000100:00100000:2.0:1736271555.766715:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024060352:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271555.766715:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b286d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024060800:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271555.766719:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060864 00000100:00100000:1.0:1736271555.766722:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1736271555.766725:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024060480:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271555.766729:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1736271555.766731:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a833dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024060416:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271555.766740:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271555.766752:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024060480:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271555.766752:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b286d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024060800:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271555.766755:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024060352:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271555.766758:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:3.0:1736271555.766758:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6980 00000100:00100000:0.0:1736271555.766759:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a833dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024060416:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (152us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271555.766761:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1736271555.766762:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1736271555.766769:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1736271555.766771:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d552600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024060544:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271555.766772:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00010000:02000000:0.0:1736271555.766774:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271555.766775:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d553440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024060864:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271555.766777:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060672 00010000:02000000:1.0:1736271555.766781:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271555.766783:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d552600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024060544:12345-0@lo:38:kworker/u8:2.0 Request processed in 11us (116us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271555.766785:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:3.0:1736271555.766790:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112767 00000100:00100000:0.0:1736271555.766794:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271555.766794:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d552f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024060672:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271555.766798:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d553440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024060864:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (93us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271555.766803:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00010000:02000000:3.0:1736271555.766806:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271555.766808:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060736 00000100:00080000:0.0:1736271555.766821:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271555.766823:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271555.766823:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6981 00000100:00100000:1.0:1736271555.766824:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024060480:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271555.766824:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d552f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024060672:12345-0@lo:38:kworker/u8:2.0 Request processed in 30us (137us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271555.766825:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024060864:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271555.766827:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d554280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024060736:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271555.766829:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736271555.766829:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112767 00000100:00080000:0.0:1736271555.766831:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271555.766832:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024060544:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271555.766843:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271555.766844:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271555.766845:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271555.766846:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024060672:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271555.766851:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271555.766852:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060608 00000100:00080000:0.0:1736271555.766853:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271555.766854:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024060416:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271555.766855:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d554280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024060736:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (60us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271555.766860:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6981 00000100:00100000:1.0:1736271555.766865:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:1.0:1736271555.766868:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024060608:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271555.766870:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024060800:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271555.766876:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024060352:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271555.766878:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024060736:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271555.766892:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024060608:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (49us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271555.766896:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1736271555.766905:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024060608:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271556.288461:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271557.290477:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271558.292476:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271559.294412:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271559.462472:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013733d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024060992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271559.462472:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2863c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024060928:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271559.462534:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271559.462586:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060992 00000100:00100000:3.0:1736271559.462589:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271559.462610:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024060928 00000100:00100000:2.0:1736271559.462632:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5780 00000100:00100000:2.0:1736271559.462637:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d550980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024060992:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271559.462642:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5781 00000100:00100000:0.0:1736271559.462646:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b284c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024060928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271559.462661:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:0.0:1736271559.462662:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271559.462691:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b284c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024060928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271559.462695:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d550980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024060992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271559.462696:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5781 00000100:00100000:2.0:1736271559.462711:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5780 00000100:00100000:1.0:1736271559.462712:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013733d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024060992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271559.462712:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b2863c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024060928:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271560.296431:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271560.540526:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271560.540576:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271560.540614:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271560.540618:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058966976 00000100:00100000:0.0:1736271560.540647:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967104 00000100:00100000:1.0:1736271560.540668:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967040 00000100:00100000:2.0:1736271560.540673:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:0.0:1736271560.540674:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 660 00000100:00100000:2.0:1736271560.540678:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058966976:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271560.540679:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d556880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058967104:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271560.540710:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 882 00000100:00100000:1.0:1736271560.540715:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d5563c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058967040:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271560.540728:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271560.540738:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d556880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058967104:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 58us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271560.540739:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058966976:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 61us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271560.540748:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:0.0:1736271560.540759:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 660 00000100:00100000:1.0:1736271560.540784:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d5563c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058967040:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 68us (169us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271560.540791:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 882 00000100:00080000:2.0:1736271560.774469:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271560.774475:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271560.774478:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271560.774484:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8341 00000100:00080000:2.0:1736271560.774487:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271560.774491:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271560.774507:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d1300 x1820604024061120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271560.774521:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024061056:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271560.774533:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271560.774536:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271560.774538:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271560.774541:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8341 00000100:00080000:2.0:1736271560.774543:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271560.774547:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271560.774547:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024061184:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271560.774556:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d5a40 x1820604024061248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271560.774581:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271560.774581:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271560.774583:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271560.774599:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271560.774600:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271560.774603:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8341 00000100:00100000:1.0:1736271560.774605:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024061120:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271560.774605:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271560.774608:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271560.774618:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d2ac0 x1820604024061376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271560.774621:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736271560.774628:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024061312:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271560.774630:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271560.774641:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061184 00000100:00100000:1.0:1736271560.774644:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024061248:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271560.774644:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271560.774647:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271560.774648:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271560.774649:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271560.774656:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8341 00000100:00080000:2.0:1736271560.774657:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271560.774661:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271560.774663:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061120 00000100:00100000:1.0:1736271560.774667:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061312 00000100:00100000:3.0:1736271560.774668:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024061440:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271560.774672:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d4c00 x1820604024061568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271560.774673:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:0.0:1736271560.774676:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2863c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024061184:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271560.774684:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1736271560.774686:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b283dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024061312:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271560.774687:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271560.774708:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:0.0:1736271560.774710:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2863c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024061184:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271560.774711:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b283dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024061312:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (63us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271560.774714:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024061120:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271560.774715:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1736271560.774717:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:0.0:1736271560.774730:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024061504:0@lo:400:kworker/u8:2.0 00010000:02000000:2.0:1736271560.774732:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271560.774735:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024061312:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271560.774736:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024061184:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271560.774742:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271560.774749:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271560.774755:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061440 00000100:00100000:1.0:1736271560.774760:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024061376:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271560.774762:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061504 00000100:00100000:1.0:1736271560.774776:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271560.774776:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6982 00000100:00100000:0.0:1736271560.774780:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6983 00000100:00100000:3.0:1736271560.774780:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafb440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024061440:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271560.774783:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d5550c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024061504:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271560.774791:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024061120:12345-0@lo:38:kworker/u8:2.0 Request processed in 76us (159us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271560.774793:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024061568:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271560.774798:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:0.0:1736271560.774803:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d5550c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024061504:12345-0@lo:400:kworker/u8:2.0 Request processed in 19us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271560.774805:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271560.774806:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6983 00000100:00100000:3.0:1736271560.774810:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafb440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024061440:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271560.774815:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6982 00000100:00080000:1.0:1736271560.774821:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271560.774823:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271560.774826:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024061120:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271560.774830:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061248 00000100:00100000:0.0:1736271560.774831:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024061504:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271560.774835:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061376 00000100:00100000:0.0:1736271560.774842:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061568 00000100:00100000:1.0:1736271560.774850:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024061440:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271560.774851:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1736271560.774855:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:2.0:1736271560.774856:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024061248:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271560.774858:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024061568:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271560.774863:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736271560.774867:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271560.774867:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112768 00000100:00100000:3.0:1736271560.774870:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024061376:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271560.774877:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271560.774886:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061056 00000100:00100000:2.0:1736271560.774893:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024061248:12345-0@lo:38:kworker/u8:2.0 Request processed in 36us (142us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271560.774895:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024061568:12345-0@lo:38:kworker/u8:2.0 Request processed in 36us (89us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271560.774903:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024061376:12345-0@lo:38:kworker/u8:2.0 Request processed in 31us (125us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271560.774904:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1736271560.774908:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:1.0:1736271560.774908:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1736271560.774908:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112768 00000100:00100000:1.0:1736271560.774916:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024061056:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271560.774969:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024061056:12345-0@lo:400:kworker/u8:2.0 Request processed in 53us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271560.774975:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:1.0:1736271560.774999:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271560.775000:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024061056:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271560.775001:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271560.775003:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024061376:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271560.775009:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271560.775011:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271560.775012:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024061568:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271560.775020:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271560.775022:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271560.775024:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024061248:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271561.298439:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271562.300460:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271563.302436:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:0.0:1736271563.552373:0:19949:0:(genops.c:1786:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 32 seconds. The obd refcount = 4. Is it stuck? 00000020:02000400:0.0:1736271563.555768:0:19949:0:(genops.c:1752:print_export_data()) lustre-MDT0000: UNLINKED ffff88008faa8000 64bb3b11-afd7-4230-a38c-2a374f07ba02 192.168.203.38@tcp 1 (0 0 0) 1 0 1 0: (null) 523986010115 stale:0 00010000:00010000:2.0:1736271564.304463:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271564.470450:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271564.470451:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271564.470465:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024061632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271564.470465:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d551c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024061696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271564.470517:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271564.470540:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061696 00000100:00100000:1.0:1736271564.470544:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271564.470563:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061632 00000100:00100000:0.0:1736271564.470571:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5782 00000100:00100000:0.0:1736271564.470574:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d2140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024061696:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271564.470583:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5783 00000100:00100000:2.0:1736271564.470592:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024061632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271564.470593:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271564.470607:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271564.470620:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d2140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024061696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271564.470624:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5782 00000100:00100000:2.0:1736271564.470637:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024061632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271564.470640:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d551c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024061696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271564.470643:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5783 00000100:00100000:1.0:1736271564.470647:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024061632:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271565.306465:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271565.548500:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271565.548542:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271565.548569:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271565.548582:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967168 00000100:00100000:2.0:1736271565.548615:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967296 00000100:00100000:1.0:1736271565.548620:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:3.0:1736271565.548623:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967232 00000100:00100000:1.0:1736271565.548626:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058967168:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271565.548646:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 663 00000100:00100000:3.0:1736271565.548650:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058967296:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271565.548654:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 886 00000100:00100000:2.0:1736271565.548659:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d551300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058967232:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:2.0:1736271565.548671:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271565.548680:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058967168:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 54us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271565.548681:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058967296:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 31us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271565.548685:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 663 00000100:00100000:1.0:1736271565.548686:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:2.0:1736271565.548699:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d551300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058967232:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 39us (129us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271565.548705:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 886 00000100:00080000:2.0:1736271565.782423:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271565.782427:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271565.782430:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271565.782434:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8346 00000100:00080000:2.0:1736271565.782436:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271565.782449:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271565.782467:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d5a40 x1820604024061824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271565.782477:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024061760:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271565.782493:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024061824:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271565.782508:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271565.782511:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271565.782513:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271565.782516:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8346 00000100:00080000:2.0:1736271565.782518:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271565.782521:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271565.782531:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d2ac0 x1820604024061952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271565.782544:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024061888:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271565.782544:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271565.782544:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271565.782545:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271565.782547:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271565.782547:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271565.782550:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8346 00000100:00080000:2.0:1736271565.782551:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271565.782552:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271565.782558:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0000 x1820604024062080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271565.782568:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271565.782568:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024061952:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271565.782568:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1736271565.782571:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271565.782572:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271565.782573:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271565.782574:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024062208:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271565.782575:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8346 00000100:00080000:2.0:1736271565.782576:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271565.782578:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271565.782585:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271565.782588:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271565.782588:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d50c0 x1820604024062272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271565.782589:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024062016:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271565.782596:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024062080:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271565.782601:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271565.782609:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271565.782610:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271565.782612:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061824 00000100:00100000:0.0:1736271565.782618:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061888 00000100:00100000:1.0:1736271565.782618:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024062272:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271565.782624:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024062144:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271565.782628:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271565.782636:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061952 00000100:00100000:0.0:1736271565.782637:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062016 00000100:00100000:2.0:1736271565.782641:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062272 00000100:00100000:0.0:1736271565.782644:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:3.0:1736271565.782644:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271565.782647:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d555580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024061888:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271565.782648:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024061760 00000100:00100000:2.0:1736271565.782649:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:2.0:1736271565.782652:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d554c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024062016:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271565.782663:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1736271565.782666:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024061760:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271565.782672:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062080 00000100:00100000:0.0:1736271565.782682:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d555580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024061888:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271565.782686:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d554c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024062016:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271565.782688:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:3.0:1736271565.782690:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112769 00000100:00100000:1.0:1736271565.782691:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024061760:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271565.782691:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1736271565.782694:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aae5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024062080:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271565.782697:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1736271565.782698:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:2.0:1736271565.782700:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aae76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024061824:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271565.782702:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:0.0:1736271565.782705:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aae4c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024061952:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271565.782705:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736271565.782709:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736271565.782712:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271565.782728:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aae76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024061824:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (186us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271565.782733:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:3.0:1736271565.782733:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aae5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024062080:12345-0@lo:38:kworker/u8:2.0 Request processed in 37us (121us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271565.782734:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024061760:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271565.782736:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aae4c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024061952:12345-0@lo:38:kworker/u8:2.0 Request processed in 30us (147us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271565.782741:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:2.0:1736271565.782744:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:3.0:1736271565.782746:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112769 00000100:00100000:2.0:1736271565.782747:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aae2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024062272:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271565.782751:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736271565.782758:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271565.782761:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271565.782764:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024061952:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271565.782764:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062208 00000100:00100000:2.0:1736271565.782767:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aae2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024062272:12345-0@lo:38:kworker/u8:2.0 Request processed in 20us (138us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736271565.782772:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271565.782772:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00080000:1.0:1736271565.782774:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271565.782776:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024062080:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271565.782777:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024062016:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271565.782781:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062144 00000100:00080000:1.0:1736271565.782783:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271565.782784:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271565.782786:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024061888:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271565.782787:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024061824:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271565.782793:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6984 00000100:00100000:2.0:1736271565.782797:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6985 00000100:00100000:3.0:1736271565.782797:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aaf9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024062208:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271565.782801:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024062144:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271565.782808:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271565.782809:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271565.782811:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024062272:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271565.782829:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aaf9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024062208:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271565.782830:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024062208:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271565.782830:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024062144:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271565.782835:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024062144:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271565.782835:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6984 00000100:00100000:2.0:1736271565.782843:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6985 00010000:00010000:2.0:1736271566.308423:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271567.310470:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271568.312489:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271569.314496:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271569.478803:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736271569.478823:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d555a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024062400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271569.478884:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271569.478914:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aae5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024062336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271569.478930:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062400 00000100:00100000:3.0:1736271569.478937:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271569.478978:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062336 00000100:00100000:0.0:1736271569.478993:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5784 00000100:00100000:0.0:1736271569.478997:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafa140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024062400:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271569.479004:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5785 00000100:00100000:1.0:1736271569.479012:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aaf8980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024062336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271569.479023:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:1.0:1736271569.479036:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271569.479087:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafa140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024062400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271569.479091:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aaf8980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024062336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271569.479093:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5784 00000100:00100000:1.0:1736271569.479099:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5785 00000100:00100000:3.0:1736271569.479146:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d555a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024062400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271569.479162:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aae5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024062336:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271570.316456:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271570.556587:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271570.556637:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271570.556678:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967360 00000100:00100000:0.0:1736271570.556683:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271570.556721:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967424 00000100:00100000:1.0:1736271570.556728:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:1.0:1736271570.556735:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058967360:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271570.556745:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967488 00000100:00100000:3.0:1736271570.556750:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 890 00000100:00100000:3.0:1736271570.556754:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d554740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058967424:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736271570.556766:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271570.556774:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 666 00000100:00100000:2.0:1736271570.556778:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d5517c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058967488:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271570.556799:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d554740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058967424:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 45us (162us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271570.556800:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058967360:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 65us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271570.556805:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:3.0:1736271570.556805:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 890 00000100:00100000:2.0:1736271570.556812:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d5517c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058967488:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 34us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271570.556818:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 666 00000100:00080000:2.0:1736271570.790454:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271570.790459:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271570.790462:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271570.790467:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8351 00000100:00080000:2.0:1736271570.790471:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271570.790476:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271570.790492:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d2f80 x1820604024062528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271570.790500:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024062464:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271570.790518:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271570.790520:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1736271570.790521:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024062528:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271570.790521:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271570.790523:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8351 00000100:00080000:2.0:1736271570.790524:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271570.790527:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271570.790545:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d1c80 x1820604024062656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271570.790562:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271570.790563:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271570.790566:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271570.790569:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271570.790569:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271570.790571:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8351 00000100:00080000:2.0:1736271570.790573:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271570.790575:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271570.790581:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d3900 x1820604024062784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271570.790590:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271570.790592:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024062656:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271570.790593:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271570.790595:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024062912:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271570.790595:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271570.790595:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271570.790598:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8351 00000100:00080000:2.0:1736271570.790599:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271570.790600:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271570.790605:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d63c0 x1820604024062976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271570.790608:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024062720:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271570.790624:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271570.790630:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271570.790635:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062528 00000100:00100000:0.0:1736271570.790639:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024062784:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271570.790640:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271570.790644:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024062592:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271570.790657:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062656 00000100:00100000:3.0:1736271570.790659:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271570.790661:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271570.790663:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271570.790664:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062720 00000100:00100000:3.0:1736271570.790670:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024062848:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271570.790676:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062592 00000100:00100000:0.0:1736271570.790678:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024062976:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271570.790687:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:3.0:1736271570.790688:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271570.790691:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafe880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024062720:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271570.790699:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271570.790700:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062912 00000100:00100000:3.0:1736271570.790712:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062848 00000100:00100000:0.0:1736271570.790719:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062976 00000100:00100000:1.0:1736271570.790727:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6986 00000100:00100000:1.0:1736271570.790731:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aae7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024062912:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271570.790732:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:3.0:1736271570.790732:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6987 00000100:00100000:3.0:1736271570.790735:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafd580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024062848:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271570.790736:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aae5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024062592:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271570.790739:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafe880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024062720:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271570.790755:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:1.0:1736271570.790764:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aae7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024062912:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271570.790766:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aae5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024062592:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271570.790766:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafd580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024062848:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271570.790770:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1736271570.790771:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6986 00000100:00100000:2.0:1736271570.790772:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d550e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024062528:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271570.790773:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:3.0:1736271570.790779:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6987 00000100:00100000:0.0:1736271570.790781:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00010000:02000000:2.0:1736271570.790782:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271570.790784:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d555f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024062656:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271570.790790:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271570.790802:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:3.0:1736271570.790805:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d553900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024062976:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271570.790806:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024062912:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271570.790806:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d550e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024062528:12345-0@lo:38:kworker/u8:2.0 Request processed in 33us (244us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271570.790807:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d555f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024062656:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (184us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271570.790810:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00010000:02000000:3.0:1736271570.790811:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271570.790812:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:1.0:1736271570.790816:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024062592:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271570.790828:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024062848:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271570.790828:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d553900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024062976:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (130us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271570.790829:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062784 00000100:00100000:3.0:1736271570.790833:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1736271570.790834:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024062720:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271570.790842:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024062464 00000100:00100000:0.0:1736271570.790843:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112770 00000100:00100000:0.0:1736271570.790845:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d552140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024062784:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271570.790849:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1736271570.790851:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271570.790853:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271570.790855:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024062976:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271570.790859:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271570.790860:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00080000:2.0:1736271570.790860:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271570.790862:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024062656:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271570.790863:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024062464:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271570.790864:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d552140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024062784:12345-0@lo:38:kworker/u8:2.0 Request processed in 18us (204us total) trans 0 rc -19/-19 00000100:00080000:2.0:1736271570.790866:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271570.790867:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112770 00000100:00080000:2.0:1736271570.790867:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271570.790869:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024062784:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271570.790873:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271570.790874:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271570.790875:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024062528:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271570.790886:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024062464:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271570.790891:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1736271570.790897:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024062464:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271571.318493:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271572.320459:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271573.322450:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736271574.324441:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271574.486494:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736271574.486496:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736271574.486511:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7d2f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024063104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271574.486511:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d552ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024063040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271574.486569:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271574.486594:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271574.486615:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063040 00000100:00100000:0.0:1736271574.486652:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063104 00000100:00100000:0.0:1736271574.486675:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5786 00000100:00100000:0.0:1736271574.486680:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024063040:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271574.486683:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5787 00000100:00100000:2.0:1736271574.486688:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024063104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271574.486704:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271574.486705:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271574.486740:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024063104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271574.486746:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5787 00000100:00100000:0.0:1736271574.486750:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024063040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271574.486751:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a7d2f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024063104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271574.486754:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5786 00000100:00100000:3.0:1736271574.486765:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d552ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024063040:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271575.326443:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271575.564516:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271575.564552:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271575.564580:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271575.564580:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967552 00000100:00100000:0.0:1736271575.564609:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967680 00000100:00100000:2.0:1736271575.564610:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:2.0:1736271575.564614:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008faa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058967552:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271575.564617:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967616 00000100:00100000:0.0:1736271575.564635:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 669 00000100:00100000:0.0:1736271575.564638:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d5504c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058967680:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271575.564652:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 894 00000100:00100000:3.0:1736271575.564657:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d553dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058967616:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:2.0:1736271575.564660:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008faa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058967552:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 46us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271575.564662:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d5504c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058967680:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 23us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271575.564665:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:0.0:1736271575.564666:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 669 00010000:02000000:3.0:1736271575.564669:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271575.564692:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d553dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058967616:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 35us (111us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271575.564698:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 894 00000100:00080000:2.0:1736271575.798426:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271575.798433:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271575.798436:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271575.798442:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8356 00000100:00080000:2.0:1736271575.798445:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271575.798450:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271575.798468:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024063168:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271575.798470:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d3900 x1820604024063232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271575.798513:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024063232:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271575.798515:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271575.798518:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271575.798519:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271575.798522:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8356 00000100:00080000:2.0:1736271575.798529:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271575.798533:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271575.798542:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271575.798544:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d63c0 x1820604024063360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271575.798546:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024063296:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271575.798553:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271575.798557:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271575.798560:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271575.798561:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271575.798564:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8356 00000100:00080000:2.0:1736271575.798565:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271575.798568:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271575.798574:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d7200 x1820604024063488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271575.798577:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024063360:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271575.798577:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271575.798588:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063168 00000100:00100000:1.0:1736271575.798590:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736271575.798594:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024063424:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271575.798595:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736271575.798596:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271575.798598:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271575.798600:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271575.798603:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8356 00000100:00080000:2.0:1736271575.798604:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271575.798607:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271575.798610:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063232 00000100:00100000:2.0:1736271575.798613:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d17c0 x1820604024063680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271575.798616:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024063488:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271575.798619:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1736271575.798622:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063296 00000100:00100000:3.0:1736271575.798623:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008faab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024063168:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271575.798631:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024063552:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271575.798634:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063360 00000100:00100000:0.0:1736271575.798635:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271575.798640:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1736271575.798643:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024063296:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271575.798649:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024063680:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271575.798657:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008faab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024063168:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271575.798659:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271575.798663:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024063296:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271575.798663:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1736271575.798666:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1736271575.798672:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271575.798674:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1736271575.798675:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d557200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024063232:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271575.798676:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271575.798680:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024063616:0@lo:400:kworker/u8:2.0 00010000:02000000:1.0:1736271575.798684:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271575.798690:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063680 00000100:00100000:0.0:1736271575.798691:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063488 00000100:00100000:2.0:1736271575.798696:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271575.798700:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:3.0:1736271575.798703:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d552ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024063360:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271575.798705:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d557200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024063232:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (153us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271575.798706:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112771 00000100:00100000:0.0:1736271575.798709:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d555a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024063488:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271575.798710:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271575.798716:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00010000:02000000:0.0:1736271575.798717:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271575.798722:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:2.0:1736271575.798725:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d5576c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024063680:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271575.798731:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d552ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024063360:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (134us total) trans 0 rc -19/-19 00010000:02000000:2.0:1736271575.798732:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271575.798737:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063552 00000100:00100000:3.0:1736271575.798737:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:0.0:1736271575.798739:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d555a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024063488:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (104us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271575.798744:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112771 00000100:00100000:2.0:1736271575.798750:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d5576c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024063680:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (77us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271575.798754:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063616 00000100:00100000:2.0:1736271575.798755:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:3.0:1736271575.798761:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6988 00000100:00100000:3.0:1736271575.798765:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024063552:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271575.798766:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6989 00000100:00100000:1.0:1736271575.798769:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024063616:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271575.798779:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271575.798782:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271575.798785:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024063680:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271575.798794:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271575.798795:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024063616:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271575.798795:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024063552:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (136us total) trans 0 rc 0/0 00000100:00080000:0.0:1736271575.798796:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271575.798798:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024063488:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271575.798799:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6989 00000100:00100000:3.0:1736271575.798801:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6988 00000100:00100000:2.0:1736271575.798803:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024063616:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271575.798804:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271575.798805:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271575.798808:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024063360:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271575.798809:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271575.798811:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024063552:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271575.798814:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271575.798816:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271575.798818:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024063232:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271575.798824:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024063296:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271575.798825:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024063168:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271575.798839:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063424 00000100:00100000:2.0:1736271575.798856:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:2.0:1736271575.798859:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024063424:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271575.798891:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024063424:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271575.798897:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:1.0:1736271575.798924:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024063424:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271576.328459:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271577.330423:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271578.332460:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271579.334438:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271579.494395:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7d2c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024063744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271579.494409:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d554280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024063808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271579.494446:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271579.494467:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271579.494484:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063744 00000100:00100000:0.0:1736271579.494506:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063808 00000100:00100000:2.0:1736271579.494528:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5788 00000100:00100000:2.0:1736271579.494533:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d28980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024063744:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271579.494534:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5789 00000100:00100000:0.0:1736271579.494538:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafb440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024063808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271579.494554:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271579.494555:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271579.494590:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafb440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024063808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271579.494594:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d28980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024063744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271579.494595:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5789 00000100:00100000:2.0:1736271579.494601:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5788 00000100:00100000:3.0:1736271579.494607:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d554280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024063808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271579.494608:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a7d2c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024063744:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271580.336410:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271580.572504:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271580.572542:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271580.572580:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967744 00000100:00100000:1.0:1736271580.572602:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967872 00000100:00100000:0.0:1736271580.572606:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271580.572630:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967808 00000100:00100000:1.0:1736271580.572633:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 672 00000100:00100000:1.0:1736271580.572639:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d5550c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058967872:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271580.572639:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:3.0:1736271580.572643:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008faae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058967744:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271580.572644:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 898 00000100:00100000:0.0:1736271580.572646:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d551c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058967808:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271580.572657:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271580.572690:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d551c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058967808:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 43us (85us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271580.572690:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d5550c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058967872:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 51us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271580.572691:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008faae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058967744:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 47us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271580.572695:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 898 00000100:00100000:3.0:1736271580.572697:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:1.0:1736271580.572702:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 672 00000100:00080000:2.0:1736271580.806424:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271580.806430:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271580.806443:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271580.806448:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8361 00000100:00080000:2.0:1736271580.806451:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271580.806456:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271580.806460:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024063872:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271580.806475:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d6d40 x1820604024063936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271580.806508:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271580.806511:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271580.806512:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271580.806514:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8361 00000100:00080000:2.0:1736271580.806516:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271580.806519:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271580.806521:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271580.806526:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024064000:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271580.806527:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d1300 x1820604024064064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271580.806539:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024063936:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271580.806545:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271580.806548:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271580.806549:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271580.806552:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8361 00000100:00080000:2.0:1736271580.806554:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271580.806557:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271580.806557:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271580.806563:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024064128:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271580.806567:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d5a40 x1820604024064192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271580.806579:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064000 00000100:00100000:0.0:1736271580.806584:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271580.806589:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271580.806589:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063872 00000100:00080000:2.0:1736271580.806592:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271580.806593:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271580.806595:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8361 00000100:00100000:0.0:1736271580.806599:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1736271580.806602:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:0.0:1736271580.806604:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024064256:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271580.806606:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064128 00000100:00080000:2.0:1736271580.806606:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271580.806609:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1736271580.806613:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008faae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024063872:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271580.806616:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d4c00 x1820604024064384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271580.806618:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:1.0:1736271580.806622:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aaf9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024064000:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271580.806626:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271580.806643:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064256 00000100:00100000:3.0:1736271580.806643:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008faae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024063872:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271580.806648:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1736271580.806652:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aaf9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024064000:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271580.806654:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1736271580.806657:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d554280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024064128:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271580.806657:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:2.0:1736271580.806662:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6990 00000100:00100000:2.0:1736271580.806665:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9ef200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024064256:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271580.806681:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271580.806690:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d554280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024064128:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271580.806694:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:3.0:1736271580.806695:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024064000:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271580.806697:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024064064:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271580.806703:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024063936 00000100:00100000:2.0:1736271580.806703:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9ef200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024064256:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271580.806705:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736271580.806706:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6990 00000100:00100000:3.0:1736271580.806708:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024064320:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271580.806713:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271580.806720:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064064 00000100:00100000:3.0:1736271580.806722:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271580.806723:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:2.0:1736271580.806726:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024063936:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271580.806727:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024064192:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271580.806730:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:0.0:1736271580.806732:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024064064:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271580.806734:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736271580.806736:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271580.806737:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064320 00000100:00100000:2.0:1736271580.806752:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024063936:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (72us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271580.806753:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6991 00000100:00100000:0.0:1736271580.806755:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024064064:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (41us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271580.806755:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:1.0:1736271580.806756:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271580.806756:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024064320:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271580.806760:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:1.0:1736271580.806766:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024064384:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271580.806776:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064192 00000100:00100000:1.0:1736271580.806780:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271580.806783:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024064320:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (59us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271580.806788:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6991 00000100:00100000:0.0:1736271580.806789:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112772 00000100:00100000:0.0:1736271580.806793:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024064192:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271580.806794:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271580.806794:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024064320:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271580.806797:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00010000:02000000:0.0:1736271580.806798:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271580.806799:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024063936:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271580.806806:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271580.806807:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271580.806810:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024064064:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271580.806819:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024064192:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (63us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271580.806824:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112772 00000100:00080000:1.0:1736271580.806828:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271580.806830:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271580.806832:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024064192:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271580.806839:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064384 00000100:00100000:0.0:1736271580.806848:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1736271580.806850:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024064384:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271580.806855:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271580.806880:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024064384:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (99us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271580.806884:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00080000:1.0:1736271580.806886:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271580.806888:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271580.806890:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024064384:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271580.806899:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024063872:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271580.806914:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024064256:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271580.806919:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024064128:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271581.338414:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271582.340430:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271583.342439:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271584.344722:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271584.502443:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c9eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024064512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271584.502444:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271584.502455:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7d2df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024064448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271584.502501:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271584.502529:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271584.502551:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064512 00000100:00100000:2.0:1736271584.502551:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064448 00000100:00100000:2.0:1736271584.502592:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5790 00000100:00100000:2.0:1736271584.502597:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9ec280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024064448:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271584.502598:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5791 00000100:00100000:0.0:1736271584.502601:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024064512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271584.502618:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271584.502619:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271584.502645:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024064512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271584.502650:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5791 00000100:00100000:2.0:1736271584.502654:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9ec280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024064448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271584.502660:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5790 00000100:00100000:1.0:1736271584.502668:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c9eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024064512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271584.502676:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a7d2df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024064448:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271585.346443:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271585.580523:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271585.580570:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271585.580591:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058967936 00000100:00100000:0.0:1736271585.580609:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271585.580632:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968064 00000100:00100000:0.0:1736271585.580633:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968000 00000100:00100000:2.0:1736271585.580638:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:2.0:1736271585.580643:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058967936:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271585.580654:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 675 00000100:00100000:0.0:1736271585.580659:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9ebdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058968064:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271585.580660:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 902 00000100:00100000:1.0:1736271585.580663:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058968000:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271585.580678:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271585.580698:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058967936:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 55us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271585.580699:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9ebdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058968064:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 40us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271585.580703:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:1.0:1736271585.580704:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058968000:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 40us (96us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271585.580705:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 675 00000100:00100000:1.0:1736271585.580708:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 902 00000100:00080000:2.0:1736271585.814422:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271585.814427:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271585.814429:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271585.814433:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8366 00000100:00080000:2.0:1736271585.814436:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271585.814439:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271585.814453:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d4740 x1820604024064640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271585.814461:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024064576:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271585.814482:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271585.814485:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271585.814486:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271585.814488:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8366 00000100:00080000:2.0:1736271585.814489:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271585.814491:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271585.814492:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024064704:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271585.814497:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d50c0 x1820604024064768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271585.814505:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271585.814507:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271585.814508:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271585.814514:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8366 00000100:00100000:0.0:1736271585.814515:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024064640:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271585.814516:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271585.814518:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271585.814524:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0e40 x1820604024064896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271585.814530:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271585.814530:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271585.814537:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271585.814539:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271585.814540:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271585.814542:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8366 00000100:00080000:2.0:1736271585.814543:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271585.814544:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271585.814548:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d1300 x1820604024065088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271585.814552:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271585.814555:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736271585.814557:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024065024:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271585.814559:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024064832:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271585.814572:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024064768:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271585.814579:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064576 00000100:00100000:1.0:1736271585.814584:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271585.814585:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271585.814600:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064704 00000100:00100000:3.0:1736271585.814600:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736271585.814604:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024064960:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271585.814608:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1736271585.814610:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064640 00000100:00100000:2.0:1736271585.814613:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024064576:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271585.814620:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271585.814624:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064832 00000100:00100000:1.0:1736271585.814627:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1736271585.814636:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024064704:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271585.814643:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1736271585.814646:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024064832:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271585.814648:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1736271585.814652:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9ed580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024064640:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271585.814655:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024064576:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271585.814660:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1736271585.814666:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024064704:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271585.814666:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024064832:12345-0@lo:400:kworker/u8:2.0 Request processed in 19us (82us total) trans 0 rc 0/0 00010000:02000000:0.0:1736271585.814668:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271585.814671:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:1.0:1736271585.814673:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1736271585.814686:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065024 00000100:00100000:0.0:1736271585.814697:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9ed580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024064640:12345-0@lo:38:kworker/u8:2.0 Request processed in 44us (145us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271585.814697:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024064832:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271585.814697:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024064576:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271585.814703:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:2.0:1736271585.814703:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064960 00000100:00100000:1.0:1736271585.814705:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024064704:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271585.814714:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6992 00000100:00100000:2.0:1736271585.814717:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024065024:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271585.814720:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271585.814727:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6993 00000100:00100000:3.0:1736271585.814731:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024064960:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271585.814733:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024064896:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271585.814747:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024065024:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271585.814752:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271585.814753:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6992 00000100:00100000:3.0:1736271585.814757:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024064960:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271585.814759:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024065088:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271585.814762:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6993 00000100:00100000:0.0:1736271585.814768:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271585.814768:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064896 00000100:00080000:0.0:1736271585.814778:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271585.814780:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271585.814782:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024064640:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271585.814782:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024064960:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271585.814783:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112773 00000100:00100000:1.0:1736271585.814786:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024064896:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271585.814789:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024065024:0@lo:400:kworker/u8:2.0 00010000:02000000:1.0:1736271585.814792:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271585.814797:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024064768 00000100:00100000:0.0:1736271585.814805:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065088 00000100:00100000:0.0:1736271585.814811:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:0.0:1736271585.814813:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9eb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024064768:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271585.814815:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024064896:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (62us total) trans 0 rc -19/-19 00010000:02000000:0.0:1736271585.814817:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271585.814820:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112773 00000100:00100000:0.0:1736271585.814830:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9eb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024064768:12345-0@lo:38:kworker/u8:2.0 Request processed in 16us (109us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271585.814833:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:0.0:1736271585.814837:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:0.0:1736271585.814839:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024065088:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271585.814841:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271585.814851:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024065088:12345-0@lo:38:kworker/u8:2.0 Request processed in 12us (83us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736271585.814853:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271585.814854:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00080000:1.0:1736271585.814855:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271585.814857:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024064896:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271585.814862:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271585.814864:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271585.814865:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024065088:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271585.814869:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271585.814870:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271585.814871:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024064768:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271586.348424:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271587.350440:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271588.352427:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271589.354417:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271589.510438:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7d2af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024065152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271589.510438:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c9eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024065216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271589.510495:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271589.510528:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065216 00000100:00100000:2.0:1736271589.510529:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271589.510548:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065152 00000100:00100000:0.0:1736271589.510574:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5792 00000100:00100000:0.0:1736271589.510579:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024065216:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271589.510585:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5793 00000100:00100000:1.0:1736271589.510588:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024065152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271589.510602:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:1.0:1736271589.510604:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271589.510637:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024065216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271589.510641:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024065152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271589.510644:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5792 00000100:00100000:1.0:1736271589.510647:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5793 00000100:00100000:2.0:1736271589.510676:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a7d2af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024065152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271589.510677:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c9eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024065216:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271590.356448:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271590.588597:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271590.588644:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271590.588669:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968128 00000100:00100000:0.0:1736271590.588687:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271590.588704:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968256 00000100:00100000:0.0:1736271590.588712:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968192 00000100:00100000:2.0:1736271590.588722:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:2.0:1736271590.588728:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058968128:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271590.588730:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 678 00000100:00100000:1.0:1736271590.588733:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9eaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058968256:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271590.588740:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 906 00000100:00100000:0.0:1736271590.588744:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058968192:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271590.588756:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271590.588780:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9eaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058968256:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 46us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271590.588780:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058968128:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 52us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271590.588786:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 678 00000100:00100000:2.0:1736271590.588786:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:0.0:1736271590.588787:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058968192:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 42us (101us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271590.588793:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 906 00000100:00080000:2.0:1736271590.822449:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271590.822456:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271590.822459:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271590.822469:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8371 00000100:00080000:2.0:1736271590.822472:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271590.822477:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271590.822491:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024065280:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271590.822496:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0980 x1820604024065344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271590.822528:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271590.822531:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271590.822532:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271590.822535:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8371 00000100:00080000:2.0:1736271590.822536:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1736271590.822538:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024065408:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271590.822539:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271590.822546:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d3900 x1820604024065472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271590.822565:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271590.822568:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024065344:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271590.822573:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271590.822576:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271590.822578:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271590.822579:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271590.822582:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8371 00000100:00080000:2.0:1736271590.822583:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271590.822586:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271590.822596:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d63c0 x1820604024065600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271590.822597:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271590.822601:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024065536:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271590.822615:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024065472:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271590.822617:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271590.822619:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1736271590.822619:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065280 00000100:00080000:2.0:1736271590.822620:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271590.822623:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8371 00000100:00080000:2.0:1736271590.822624:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271590.822626:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271590.822633:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271590.822635:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d50c0 x1820604024065792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271590.822650:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065408 00000100:00100000:0.0:1736271590.822651:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024065600:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271590.822651:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024065728:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271590.822660:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1736271590.822664:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024065280:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271590.822673:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271590.822675:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065344 00000100:00100000:2.0:1736271590.822676:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271590.822684:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024065792:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271590.822686:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065472 00000100:00100000:1.0:1736271590.822698:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:3.0:1736271590.822698:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024065280:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271590.822701:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024065280:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271590.822702:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024065408:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271590.822703:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1736271590.822706:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271590.822721:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065728 00000100:00100000:0.0:1736271590.822728:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065600 00000100:00100000:3.0:1736271590.822732:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065792 00000100:00100000:1.0:1736271590.822734:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024065408:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271590.822740:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1736271590.822740:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6994 00000100:00100000:2.0:1736271590.822743:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024065728:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271590.822743:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1736271590.822745:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112774 00000100:00100000:3.0:1736271590.822746:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024065344:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271590.822748:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ed580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024065600:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271590.822752:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:1.0:1736271590.822754:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ec740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024065472:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271590.822756:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736271590.822756:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736271590.822761:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271590.822768:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024065728:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271590.822779:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024065344:12345-0@lo:38:kworker/u8:2.0 Request processed in 32us (184us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271590.822781:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6994 00000100:00100000:3.0:1736271590.822784:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1736271590.822788:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ed580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024065600:12345-0@lo:38:kworker/u8:2.0 Request processed in 38us (114us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271590.822789:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ec740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024065472:12345-0@lo:38:kworker/u8:2.0 Request processed in 32us (155us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271590.822792:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1736271590.822794:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112774 00000100:00100000:1.0:1736271590.822796:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:3.0:1736271590.822796:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ee3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024065792:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271590.822801:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271590.822808:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024065728:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271590.822819:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ee3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024065792:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (113us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736271590.822820:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271590.822820:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271590.822823:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271590.822824:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1736271590.822826:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024065600:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271590.822833:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065536 00000100:00080000:0.0:1736271590.822834:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271590.822834:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1736271590.822836:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271590.822838:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024065792:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271590.822840:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024065664:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271590.822845:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736271590.822845:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00080000:0.0:1736271590.822846:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271590.822848:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024065536:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271590.822849:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024065344:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271590.822856:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271590.822857:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271590.822858:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271590.822860:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024065472:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271590.822871:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065664 00000100:00100000:3.0:1736271590.822872:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024065536:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (53us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271590.822875:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024065536:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271590.822877:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1736271590.822884:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6995 00000100:00100000:2.0:1736271590.822887:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024065664:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271590.822897:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024065408:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271590.822912:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024065664:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (55us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271590.822916:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6995 00000100:00100000:1.0:1736271590.822936:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024065664:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271591.358442:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271592.360915:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271593.362476:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271594.364443:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271594.518407:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736271594.518412:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736271594.518422:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024065920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271594.518422:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7d29c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024065856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271594.518478:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271594.518513:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065920 00000100:00100000:2.0:1736271594.518521:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271594.518546:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065856 00000100:00100000:1.0:1736271594.518556:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5794 00000100:00100000:1.0:1736271594.518561:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024065920:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271594.518562:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5795 00000100:00100000:0.0:1736271594.518566:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b4fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024065856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1736271594.518585:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:0.0:1736271594.518594:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736271594.518615:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024065920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271594.518621:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5794 00000100:00100000:0.0:1736271594.518633:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b4fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024065856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271594.518638:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5795 00000100:00100000:3.0:1736271594.518642:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a7d29c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024065856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271594.518644:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024065920:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271595.366470:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271595.596548:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271595.596590:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271595.596629:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271595.596636:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968320 00000100:00100000:1.0:1736271595.596666:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968448 00000100:00100000:3.0:1736271595.596680:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:3.0:1736271595.596684:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058968320:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271595.596692:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968384 00000100:00100000:1.0:1736271595.596706:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 681 00000100:00100000:1.0:1736271595.596711:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934eb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058968448:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271595.596731:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 910 00000100:00100000:2.0:1736271595.596734:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058968384:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:3.0:1736271595.596739:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058968320:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 55us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271595.596743:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 200 00010000:02000000:2.0:1736271595.596746:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271595.596758:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934eb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058968448:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 47us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271595.596763:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 681 00000100:00100000:2.0:1736271595.596770:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058968384:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 36us (141us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271595.596774:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 910 00000100:00080000:0.0:1736271595.830485:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736271595.830489:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ebdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024065984:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271595.830492:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271595.830496:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271595.830501:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8376 00000100:00080000:0.0:1736271595.830504:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271595.830510:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271595.830531:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934eda40 x1820604024066048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271595.830556:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271595.830580:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271595.830584:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271595.830586:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271595.830588:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8376 00000100:00080000:0.0:1736271595.830590:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271595.830594:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271595.830603:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934ed0c0 x1820604024066176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271595.830613:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271595.830616:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1736271595.830623:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ea140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024066240:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271595.830624:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ecc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024066112:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271595.830628:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271595.830630:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8376 00000100:00080000:0.0:1736271595.830631:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271595.830634:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271595.830641:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934eed40 x1820604024066304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271595.830641:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024066048:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271595.830659:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271595.830660:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271595.830662:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271595.830663:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271595.830665:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8376 00000100:00080000:0.0:1736271595.830665:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271595.830667:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271595.830673:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934e9300 x1820604024066496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271595.830678:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271595.830681:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024066368:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271595.830690:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ea600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024066432:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271595.830707:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066240 00000100:00100000:1.0:1736271595.830718:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271595.830734:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066112 00000100:00100000:0.0:1736271595.830740:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271595.830747:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1736271595.830752:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024066240:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271595.830758:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271595.830768:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066048 00000100:00100000:0.0:1736271595.830769:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066368 00000100:00100000:1.0:1736271595.830774:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ed0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024066176:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271595.830782:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:0.0:1736271595.830787:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066432 00000100:00100000:3.0:1736271595.830787:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935197c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024066112:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271595.830794:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271595.830796:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024066240:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271595.830797:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6996 00000100:00100000:0.0:1736271595.830799:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024066368:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271595.830802:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1736271595.830817:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066176 00000100:00100000:1.0:1736271595.830819:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024066304:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271595.830824:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024066368:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271595.830826:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:0.0:1736271595.830827:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6996 00000100:00100000:2.0:1736271595.830829:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024066048:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271595.830835:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935197c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024066112:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271595.830836:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6997 00000100:00100000:0.0:1736271595.830837:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ec280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024066432:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271595.830841:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271595.830842:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00010000:02000000:2.0:1736271595.830843:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271595.830855:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ec280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024066432:12345-0@lo:400:kworker/u8:2.0 Request processed in 17us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271595.830857:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024066496:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271595.830859:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:3.0:1736271595.830862:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d28980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024066176:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271595.830863:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6997 00000100:00100000:2.0:1736271595.830866:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024066048:12345-0@lo:38:kworker/u8:2.0 Request processed in 37us (109us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271595.830871:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00010000:02000000:3.0:1736271595.830873:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271595.830876:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271595.830884:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066496 00000100:00100000:0.0:1736271595.830894:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00080000:1.0:1736271595.830894:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271595.830897:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024066496:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271595.830897:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271595.830897:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d28980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024066176:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (103us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271595.830901:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024066048:0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271595.830902:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271595.830903:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00080000:1.0:1736271595.830909:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271595.830911:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271595.830913:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ed0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024066176:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271595.830915:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ea140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024066240:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271595.830918:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024066496:12345-0@lo:38:kworker/u8:2.0 Request processed in 21us (43us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271595.830921:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:3.0:1736271595.830934:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ecc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024066112:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271595.830936:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066304 00000100:00080000:1.0:1736271595.830938:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271595.830939:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024065984 00000100:00080000:1.0:1736271595.830940:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271595.830942:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024066496:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271595.830947:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112775 00000100:00100000:0.0:1736271595.830949:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024066304:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271595.830952:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271595.830964:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1736271595.830967:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024065984:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271595.830974:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024066304:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (134us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271595.830977:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112775 00000100:00080000:1.0:1736271595.830986:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271595.830989:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271595.830991:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024066304:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271595.830993:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ea600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024066432:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271595.830995:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024065984:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271595.830999:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ebdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024065984:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271595.831001:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1736271595.831021:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024066368:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271596.368471:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271597.370455:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271598.372475:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271599.374436:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271599.526414:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736271599.526433:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024066560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271599.526434:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736271599.526451:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7d2bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024066624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271599.526488:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271599.526516:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271599.526542:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066624 00000100:00100000:1.0:1736271599.526566:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066560 00000100:00100000:0.0:1736271599.526583:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5796 00000100:00100000:0.0:1736271599.526588:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024066624:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271599.526594:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5797 00000100:00100000:1.0:1736271599.526597:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d0e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024066560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271599.526610:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:1.0:1736271599.526611:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271599.526642:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024066624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271599.526648:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d0e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024066560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271599.526653:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5796 00000100:00100000:1.0:1736271599.526660:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5797 00000100:00100000:3.0:1736271599.526660:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a7d2bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024066624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271599.526664:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024066560:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271600.376459:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271600.604572:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271600.604611:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271600.604639:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271600.604640:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968512 00000100:00100000:3.0:1736271600.604676:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968640 00000100:00100000:2.0:1736271600.604684:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:2.0:1736271600.604689:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058968512:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271600.604699:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968576 00000100:00100000:3.0:1736271600.604703:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 684 00000100:00100000:3.0:1736271600.604707:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934eaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058968640:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271600.604724:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 914 00000100:00100000:1.0:1736271600.604727:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ebdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058968576:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271600.604737:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271600.604740:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058968512:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 51us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271600.604741:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934eaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058968640:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 33us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271600.604746:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:3.0:1736271600.604746:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 684 00000100:00100000:1.0:1736271600.604757:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ebdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058968576:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 30us (118us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271600.604762:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 914 00000100:00080000:0.0:1736271600.838416:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271600.838422:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271600.838426:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271600.838431:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8381 00000100:00080000:0.0:1736271600.838435:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271600.838440:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271600.838445:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ea600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024066688:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271600.838458:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934edf00 x1820604024066752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271600.838484:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271600.838486:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271600.838487:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271600.838489:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8381 00000100:00080000:0.0:1736271600.838490:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271600.838493:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271600.838494:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934edf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024066752:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271600.838498:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934ef200 x1820604024066880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271600.838509:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271600.838518:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271600.838520:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271600.838520:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271600.838521:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271600.838522:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8381 00000100:00080000:0.0:1736271600.838523:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271600.838534:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271600.838535:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271600.838537:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ef200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024066880:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271600.838541:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934e8e40 x1820604024067008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271600.838546:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ee880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024066816:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271600.838550:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271600.838552:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271600.838554:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271600.838555:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271600.838556:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8381 00000100:00080000:0.0:1736271600.838557:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271600.838559:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271600.838561:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024067008:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271600.838562:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271600.838563:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934e84c0 x1820604024067200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271600.838573:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066752 00000100:00100000:2.0:1736271600.838574:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024067136:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271600.838576:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024067072:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271600.838577:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271600.838589:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024067200:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271600.838593:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271600.838599:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066880 00000100:00100000:0.0:1736271600.838602:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067008 00000100:00100000:1.0:1736271600.838606:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271600.838612:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066816 00000100:00100000:2.0:1736271600.838614:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271600.838617:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112776 00000100:00100000:0.0:1736271600.838620:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024067008:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271600.838627:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067200 00000100:00100000:3.0:1736271600.838628:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00010000:02000000:0.0:1736271600.838629:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271600.838629:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736271600.838632:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024066944:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271600.838632:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024066816:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271600.838639:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1736271600.838643:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d29c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024066752:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271600.838649:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:1.0:1736271600.838650:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271600.838654:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024067008:12345-0@lo:38:kworker/u8:2.0 Request processed in 33us (76us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271600.838659:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112776 00000100:00100000:2.0:1736271600.838664:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067136 00000100:00100000:1.0:1736271600.838665:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d29c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024066752:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (145us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271600.838670:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1736271600.838678:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066944 00000100:00100000:3.0:1736271600.838681:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024066816:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271600.838682:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067072 00000100:00100000:3.0:1736271600.838686:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1736271600.838688:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1736271600.838690:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6998 00000100:00100000:2.0:1736271600.838694:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6999 00000100:00100000:0.0:1736271600.838695:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024067136:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271600.838696:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1736271600.838697:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024066944:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271600.838697:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024067072:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271600.838697:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024066880:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271600.838702:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271600.838722:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024066880:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (171us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271600.838727:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024067136:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271600.838727:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1736271600.838728:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024066944:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271600.838732:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024067072:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271600.838733:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6998 00000100:00100000:1.0:1736271600.838734:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1736271600.838736:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:3.0:1736271600.838739:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024067200:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271600.838743:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6999 00010000:02000000:3.0:1736271600.838744:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271600.838760:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024066944:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271600.838769:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024066688 00000100:00100000:1.0:1736271600.838770:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024067072:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271600.838778:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024067200:12345-0@lo:38:kworker/u8:2.0 Request processed in 37us (171us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271600.838783:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:2.0:1736271600.838786:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1736271600.838789:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024066688:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271600.838792:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271600.838794:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271600.838796:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024067200:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271600.838802:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271600.838803:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271600.838805:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024067008:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271600.838809:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024066688:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (301us total) trans 0 rc 0/0 00000100:00080000:1.0:1736271600.838811:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271600.838812:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271600.838814:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ef200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024066880:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271600.838815:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1736271600.838819:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271600.838821:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271600.838822:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934edf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024066752:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271600.838837:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024067136:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271600.838843:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ee880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024066816:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271600.838849:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ea600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024066688:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271601.378431:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271602.380451:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271603.382436:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271604.384450:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271604.534403:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271604.534418:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024067264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271604.534435:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b99af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024067328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271604.534476:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271604.534507:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271604.534534:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067328 00000100:00100000:1.0:1736271604.534562:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067264 00000100:00100000:0.0:1736271604.534580:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5798 00000100:00100000:0.0:1736271604.534583:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024067328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271604.534604:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736271604.534606:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5799 00000100:00100000:1.0:1736271604.534610:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024067264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736271604.534632:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271604.534635:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024067328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271604.534639:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5798 00000100:00100000:2.0:1736271604.534656:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b99af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024067328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271604.534664:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024067264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271604.534670:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5799 00000100:00100000:3.0:1736271604.534677:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024067264:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271605.386426:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271605.612509:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271605.612551:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271605.612582:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968704 00000100:00100000:0.0:1736271605.612590:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271605.612611:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968832 00000100:00100000:1.0:1736271605.612616:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968768 00000100:00100000:2.0:1736271605.612624:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 204 00000100:00100000:2.0:1736271605.612629:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058968704:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271605.612635:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 687 00000100:00100000:1.0:1736271605.612638:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ea600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058968832:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271605.612643:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 918 00000100:00100000:0.0:1736271605.612647:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058968768:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271605.612658:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271605.612676:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ea600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058968832:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271605.612678:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058968704:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 48us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271605.612681:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 687 00000100:00100000:2.0:1736271605.612684:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 204 00000100:00100000:0.0:1736271605.612685:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058968768:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 37us (95us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271605.612691:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 918 00000100:00080000:0.0:1736271605.846418:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271605.846425:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271605.846427:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271605.846433:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8386 00000100:00080000:0.0:1736271605.846436:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271605.846441:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271605.846448:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024067392:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271605.846457:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934edf00 x1820604024067456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271605.846497:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271605.846501:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271605.846511:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736271605.846511:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1736271605.846514:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8386 00000100:00100000:1.0:1736271605.846515:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271605.846516:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271605.846519:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271605.846526:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ef200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024067520:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271605.846528:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934e8e40 x1820604024067584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271605.846544:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271605.846547:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1736271605.846547:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067392 00000100:00080000:0.0:1736271605.846548:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271605.846548:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934edf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024067456:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271605.846550:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8386 00000100:00080000:0.0:1736271605.846551:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271605.846554:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271605.846555:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271605.846562:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934e9c80 x1820604024067712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271605.846572:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1736271605.846576:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024067392:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271605.846581:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067520 00000100:00080000:0.0:1736271605.846592:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736271605.846593:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024067648:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271605.846595:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271605.846596:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271605.846598:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8386 00000100:00080000:0.0:1736271605.846600:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271605.846602:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271605.846605:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:3.0:1736271605.846605:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024067392:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271605.846609:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934e9300 x1820604024067904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271605.846609:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1736271605.846611:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271605.846615:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024067520:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271605.846628:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024067840:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271605.846634:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067648 00000100:00100000:1.0:1736271605.846649:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024067520:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271605.846652:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1736271605.846656:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1736271605.846656:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024067648:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271605.846659:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271605.846661:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ef200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024067520:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271605.846681:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024067392:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271605.846681:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271605.846686:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024067648:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (75us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271605.846689:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024067648:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271605.846691:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1736271605.846693:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024067584:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271605.846699:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736271605.846700:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067456 00000100:00100000:0.0:1736271605.846703:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024067776:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271605.846708:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271605.846719:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067584 00000100:00100000:0.0:1736271605.846720:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271605.846721:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:3.0:1736271605.846723:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b998e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024067456:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271605.846725:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024067712:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271605.846730:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00010000:02000000:3.0:1736271605.846731:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271605.846733:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b99cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024067584:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271605.846740:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067840 00010000:02000000:2.0:1736271605.846740:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271605.846741:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271605.846747:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b998e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024067456:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (67us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271605.846751:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:1.0:1736271605.846756:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024067904:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271605.846758:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067776 00000100:00100000:2.0:1736271605.846759:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b99cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024067584:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (51us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271605.846763:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:0.0:1736271605.846769:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7000 00000100:00100000:1.0:1736271605.846771:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271605.846772:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7001 00000100:00100000:0.0:1736271605.846773:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ecc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024067840:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271605.846775:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e8980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024067776:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271605.846782:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067904 00000100:00080000:1.0:1736271605.846787:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271605.846789:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271605.846791:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e8980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024067776:12345-0@lo:400:kworker/u8:2.0 Request processed in 16us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271605.846792:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934edf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024067456:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271605.846792:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:2.0:1736271605.846795:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b99da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024067904:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271605.846798:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ecc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024067840:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (140us total) trans 0 rc 0/0 00000100:00080000:1.0:1736271605.846799:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:02000000:2.0:1736271605.846799:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271605.846800:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7001 00000100:00080000:1.0:1736271605.846801:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271605.846804:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7000 00000100:00100000:1.0:1736271605.846804:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024067584:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271605.846813:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b99da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024067904:12345-0@lo:38:kworker/u8:2.0 Request processed in 18us (42us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271605.846818:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:0.0:1736271605.846821:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067712 00000100:00100000:3.0:1736271605.846821:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024067776:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271605.846825:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271605.846826:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271605.846826:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024067840:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271605.846829:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024067904:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271605.846832:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112777 00000100:00100000:0.0:1736271605.846835:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b99df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024067712:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271605.846841:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736271605.846873:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271605.846875:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271605.846878:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024067712:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271605.846879:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b99df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024067712:12345-0@lo:38:kworker/u8:2.0 Request processed in 42us (137us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271605.846884:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112777 00010000:00010000:2.0:1736271606.388454:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271607.390448:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271608.392457:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271609.394421:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271609.542409:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024067968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271609.542422:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ed0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024068032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271609.542470:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271609.542515:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271609.542549:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068032 00000100:00100000:1.0:1736271609.542579:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024067968 00000100:00100000:0.0:1736271609.542582:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5800 00000100:00100000:0.0:1736271609.542586:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024068032:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271609.542603:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5801 00002000:00000024:0.0:1736271609.542606:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271609.542607:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024067968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1736271609.542621:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271609.542652:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024068032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271609.542652:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024067968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271609.542657:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5801 00000100:00100000:0.0:1736271609.542662:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5800 00000100:00100000:2.0:1736271609.542683:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ed0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024068032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271609.542687:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024067968:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271610.396423:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271610.620525:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271610.620554:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271610.620598:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271610.620601:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969024 00000100:00100000:2.0:1736271610.620612:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968960 00000100:00100000:2.0:1736271610.620644:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 690 00000100:00100000:2.0:1736271610.620650:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ea140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058969024:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271610.620651:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 922 00000100:00100000:1.0:1736271610.620655:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058968960:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271610.620666:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271610.620667:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058968896 00000100:00100000:3.0:1736271610.620692:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 206 00000100:00100000:3.0:1736271610.620697:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058968896:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271610.620707:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ea140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058969024:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 58us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271610.620711:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 690 00000100:00100000:1.0:1736271610.620712:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058968960:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 57us (158us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271610.620718:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 922 00000100:00100000:3.0:1736271610.620721:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058968896:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 24us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271610.620727:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 206 00000100:00080000:0.0:1736271610.854409:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271610.854414:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271610.854416:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271610.854421:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8391 00000100:00080000:0.0:1736271610.854423:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271610.854427:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271610.854440:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934e9c80 x1820604024068160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271610.854443:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ed0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024068096:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271610.854459:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271610.854461:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271610.854461:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271610.854464:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8391 00000100:00080000:0.0:1736271610.854465:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271610.854467:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271610.854472:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934e9300 x1820604024068288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271610.854474:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024068224:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271610.854485:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271610.854487:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271610.854487:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271610.854489:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8391 00000100:00080000:0.0:1736271610.854490:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271610.854492:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271610.854496:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934e8e40 x1820604024068416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271610.854505:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024068160:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271610.854506:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736271610.854506:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271610.854515:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271610.854517:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271610.854518:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271610.854521:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8391 00000100:00080000:0.0:1736271610.854523:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271610.854525:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271610.854533:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934ef200 x1820604024068608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271610.854534:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024068544:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271610.854535:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271610.854546:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024068288:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271610.854553:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271610.854553:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068096 00000100:00100000:1.0:1736271610.854560:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271610.854569:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024068416:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271610.854570:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068224 00000100:00100000:2.0:1736271610.854571:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934edf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024068480:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271610.854580:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1736271610.854586:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271610.854586:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271610.854590:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024068096:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271610.854595:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068160 00000100:00100000:1.0:1736271610.854599:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ef200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024068608:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271610.854602:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271610.854605:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068288 00000100:00100000:2.0:1736271610.854606:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024068352:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271610.854614:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271610.854618:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068608 00000100:00100000:2.0:1736271610.854622:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271610.854625:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1736271610.854628:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024068224:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271610.854630:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024068096:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271610.854632:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068352 00000100:00100000:3.0:1736271610.854636:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1736271610.854639:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068544 00000100:00100000:1.0:1736271610.854647:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1736271610.854650:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024068352:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271610.854656:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068480 00000100:00100000:0.0:1736271610.854663:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024068224:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271610.854668:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1736271610.854668:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7002 00000100:00100000:2.0:1736271610.854671:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d2140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024068544:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271610.854671:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ed0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024068096:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271610.854677:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:1.0:1736271610.854678:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024068352:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271610.854679:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b99bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024068160:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271610.854684:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00010000:02000000:0.0:1736271610.854688:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271610.854693:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7003 00000100:00100000:2.0:1736271610.854694:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d2140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024068544:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271610.854695:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:1.0:1736271610.854698:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b99a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024068288:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271610.854698:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7002 00000100:00100000:3.0:1736271610.854698:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024068480:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:1.0:1736271610.854704:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271610.854710:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b99bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024068160:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (175us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271610.854715:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:2.0:1736271610.854718:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:1.0:1736271610.854720:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b99a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024068288:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (161us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271610.854722:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b99af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024068608:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271610.854724:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024068480:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271610.854725:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:3.0:1736271610.854730:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7003 00010000:02000000:2.0:1736271610.854732:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271610.854734:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068416 00000100:00100000:1.0:1736271610.854747:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024068352:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271610.854748:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112778 00000100:00100000:0.0:1736271610.854751:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b99f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024068416:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271610.854757:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271610.854757:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b99af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024068608:12345-0@lo:38:kworker/u8:2.0 Request processed in 35us (143us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271610.854760:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024068544:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271610.854762:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934edf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024068480:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271610.854763:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:0.0:1736271610.854778:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b99f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024068416:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (192us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736271610.854783:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271610.854785:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271610.854787:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112778 00000100:00100000:3.0:1736271610.854790:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024068224:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271610.854800:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ef200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024068608:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271610.854808:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271610.854810:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271610.854812:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024068160:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271610.854818:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271610.854820:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271610.854822:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024068288:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271610.854828:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271610.854830:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271610.854831:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024068416:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271611.398444:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271612.400433:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271613.402462:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271614.404441:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271614.550427:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736271614.550445:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009351a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024068672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271614.550461:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024068736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271614.550506:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271614.550540:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271614.550562:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068672 00000100:00100000:2.0:1736271614.550584:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068736 00000100:00100000:1.0:1736271614.550600:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5802 00000100:00100000:1.0:1736271614.550605:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024068672:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271614.550616:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5803 00000100:00100000:2.0:1736271614.550620:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024068736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736271614.550629:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271614.550637:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:1.0:1736271614.550665:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024068672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271614.550672:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5802 00000100:00100000:2.0:1736271614.550673:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024068736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271614.550679:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5803 00000100:00100000:0.0:1736271614.550683:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024068736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271614.550685:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009351a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024068672:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271615.406422:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271615.628498:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271615.628532:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271615.628570:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271615.628595:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969088 00000100:00100000:0.0:1736271615.628613:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969152 00000100:00100000:3.0:1736271615.628613:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969216 00000100:00100000:0.0:1736271615.628644:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 693 00000100:00100000:2.0:1736271615.628648:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 208 00000100:00100000:0.0:1736271615.628650:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058969216:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271615.628654:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058969088:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271615.628656:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 926 00000100:00100000:3.0:1736271615.628659:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058969152:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736271615.628672:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271615.628729:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058969216:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 80us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271615.628729:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058969088:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271615.628729:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058969152:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 68us (159us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271615.628733:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 926 00000100:00100000:2.0:1736271615.628736:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 208 00000100:00100000:0.0:1736271615.628745:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 693 00000100:00080000:0.0:1736271615.862480:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271615.862487:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271615.862491:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271615.862498:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8396 00000100:00080000:0.0:1736271615.862503:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271615.862509:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271615.862514:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ef200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024068800:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271615.862530:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934eed40 x1820604024068864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271615.862569:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271615.862572:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271615.862572:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271615.862573:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736271615.862584:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024068864:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271615.862591:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8396 00000100:00080000:0.0:1736271615.862593:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271615.862598:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271615.862608:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934e84c0 x1820604024068992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271615.862608:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934edf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024068928:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271615.862626:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271615.862629:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271615.862630:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271615.862632:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068800 00000100:00080000:0.0:1736271615.862633:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8396 00000100:00080000:0.0:1736271615.862635:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271615.862638:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271615.862641:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271615.862647:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800934ed0c0 x1820604024069120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271615.862661:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1736271615.862665:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024068800:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271615.862672:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271615.862672:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271615.862675:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271615.862676:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271615.862679:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8396 00000100:00080000:0.0:1736271615.862680:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271615.862683:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271615.862687:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024068992:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271615.862688:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736271615.862692:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024069056:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271615.862693:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011d550980 x1820604024069312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271615.862707:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024068800:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271615.862712:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1736271615.862715:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271615.862719:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068864 00000100:00100000:3.0:1736271615.862723:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068928 00000100:00100000:2.0:1736271615.862733:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934ed0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024069120:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271615.862740:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024068992 00000100:00100000:3.0:1736271615.862742:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1736271615.862745:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:3.0:1736271615.862745:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024068928:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271615.862748:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024068864:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271615.862753:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271615.862754:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:0.0:1736271615.862758:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024068992:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271615.862758:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736271615.862764:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271615.862767:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024068928:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271615.862770:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1736271615.862780:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024068864:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (137us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271615.862784:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00100000:3.0:1736271615.862784:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271615.862791:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271615.862792:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069056 00000100:00080000:2.0:1736271615.862794:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271615.862798:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024068864:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271615.862799:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1736271615.862801:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024069056:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271615.862803:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934edf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024068928:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271615.862814:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024068992:12345-0@lo:38:kworker/u8:2.0 Request processed in 56us (99us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271615.862820:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1736271615.862823:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024069056:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (39us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271615.862825:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d550980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024069312:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271615.862827:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1736271615.862830:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069120 00000100:00100000:1.0:1736271615.862842:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024069056:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271615.862842:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112779 00000100:00100000:2.0:1736271615.862843:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271615.862844:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aae04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024069248:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271615.862845:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024069120:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271615.862850:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1736271615.862860:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271615.862863:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271615.862865:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024068992:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271615.862872:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271615.862875:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736271615.862875:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024069120:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (122us total) trans 0 rc -19/-19 00000100:00080000:2.0:1736271615.862877:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271615.862878:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112779 00000100:00100000:2.0:1736271615.862879:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ed0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024069120:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271615.862906:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934ef200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024068800:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271615.862913:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069312 00000100:00100000:0.0:1736271615.862917:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736271615.862918:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069248 00000100:00100000:0.0:1736271615.862921:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aae6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024069184:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271615.862937:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1736271615.862938:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271615.862942:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7004 00000100:00100000:2.0:1736271615.862942:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024069312:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271615.862945:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024069248:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:2.0:1736271615.862954:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271615.862970:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024069248:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271615.862973:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7004 00000100:00100000:0.0:1736271615.862978:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aae04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024069248:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271615.862980:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069184 00000100:00100000:2.0:1736271615.863004:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024069312:12345-0@lo:38:kworker/u8:2.0 Request processed in 42us (142us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271615.863011:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:3.0:1736271615.863012:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7005 00000100:00100000:3.0:1736271615.863014:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafa140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024069184:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271615.863037:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271615.863040:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271615.863043:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d550980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024069312:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271615.863049:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafa140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024069184:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271615.863054:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7005 00000100:00100000:0.0:1736271615.863075:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aae6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024069184:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271616.408492:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271617.410475:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271618.412455:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271619.414452:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271619.558444:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271619.558460:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aaf8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024069376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271619.558473:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736271619.558502:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024069440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271619.558512:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271619.558554:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271619.558571:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069376 00000100:00100000:1.0:1736271619.558589:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069440 00000100:00100000:2.0:1736271619.558620:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5804 00000100:00100000:2.0:1736271619.558625:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024069376:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271619.558634:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5805 00000100:00100000:1.0:1736271619.558638:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024069440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1736271619.558659:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271619.558659:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:1.0:1736271619.558696:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024069440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271619.558701:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024069376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271619.558702:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5805 00000100:00100000:2.0:1736271619.558707:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5804 00000100:00100000:0.0:1736271619.558721:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aaf8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024069376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271619.558754:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024069440:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271620.416524:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271620.636461:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271620.636507:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271620.636552:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271620.636570:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969280 00000100:00100000:3.0:1736271620.636575:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969408 00000100:00100000:0.0:1736271620.636577:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969344 00000100:00100000:0.0:1736271620.636599:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 696 00000100:00100000:0.0:1736271620.636605:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aaf8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058969408:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271620.636605:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 930 00000100:00100000:3.0:1736271620.636608:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058969344:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:1.0:1736271620.636615:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 210 00010000:02000000:3.0:1736271620.636619:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271620.636620:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058969280:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271620.636651:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aaf8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058969408:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 48us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271620.636651:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058969344:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 43us (100us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271620.636655:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 930 00000100:00100000:0.0:1736271620.636664:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 696 00000100:00100000:1.0:1736271620.636666:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058969280:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 46us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271620.636671:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 210 00000100:00080000:0.0:1736271620.870428:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271620.870434:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271620.870437:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271620.870442:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8401 00000100:00080000:0.0:1736271620.870445:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271620.870450:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271620.870463:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aae6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024069504:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271620.870469:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009aae04c0 x1820604024069568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271620.870509:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271620.870512:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271620.870513:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271620.870516:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8401 00000100:00080000:0.0:1736271620.870517:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271620.870520:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271620.870527:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aae04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024069568:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271620.870530:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271620.870531:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b35e880 x1820604024069696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271620.870532:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c9ec280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024069632:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271620.870549:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271620.870552:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271620.870553:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271620.870556:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8401 00000100:00100000:3.0:1736271620.870556:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271620.870557:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271620.870560:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271620.870568:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b35b900 x1820604024069824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271620.870579:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024069696:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271620.870581:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069568 00000100:00100000:1.0:1736271620.870592:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271620.870599:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271620.870601:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271620.870602:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271620.870604:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8401 00000100:00080000:0.0:1736271620.870605:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271620.870607:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271620.870607:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069632 00000100:00100000:0.0:1736271620.870613:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b35d580 x1820604024070016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271620.870614:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:3.0:1736271620.870617:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024069568:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271620.870622:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1736271620.870624:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084648980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024069632:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271620.870626:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b358980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024069760:0@lo:400:kworker/u8:2.0 00010000:02000000:3.0:1736271620.870627:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271620.870633:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736271620.870640:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024069952:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271620.870648:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271620.870653:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084648980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024069632:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (63us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271620.870657:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:3.0:1736271620.870662:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024069568:12345-0@lo:38:kworker/u8:2.0 Request processed in 44us (106us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271620.870665:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069760 00000100:00100000:3.0:1736271620.870667:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:0.0:1736271620.870668:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271620.870671:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024069888:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271620.870673:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271620.870674:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1736271620.870676:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b359c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024069760:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271620.870686:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271620.870689:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271620.870699:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b359c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024069760:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (51us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271620.870704:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1736271620.870711:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069696 00000100:00080000:3.0:1736271620.870712:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271620.870713:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c9ec280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024069632:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271620.870715:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b358980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024069760:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271620.870715:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271620.870718:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1736271620.870718:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aae04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024069568:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271620.870721:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ef200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024069696:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271620.870727:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271620.870730:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024069824:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271620.870746:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ef200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024069696:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (60us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271620.870750:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069952 00000100:00100000:3.0:1736271620.870750:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271620.870760:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024070016:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271620.870761:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:0.0:1736271620.870762:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069504 00000100:00100000:3.0:1736271620.870773:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271620.870777:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069888 00000100:00100000:0.0:1736271620.870782:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1736271620.870782:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7006 00000100:00100000:0.0:1736271620.870784:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024069504:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271620.870786:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271620.870787:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024069952:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271620.870792:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7007 00000100:00080000:3.0:1736271620.870792:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271620.870794:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024069696:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271620.870795:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3584c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024069888:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271620.870810:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024069504:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271620.870813:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024069824 00000100:00100000:0.0:1736271620.870815:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1736271620.870821:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024069952:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271620.870825:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112780 00000100:00100000:2.0:1736271620.870826:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7006 00000100:00100000:3.0:1736271620.870827:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ed0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024069824:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271620.870832:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271620.870851:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aae6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024069504:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271620.870854:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ed0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024069824:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (104us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271620.870857:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3584c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024069888:12345-0@lo:400:kworker/u8:2.0 Request processed in 60us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271620.870857:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112780 00000100:00100000:1.0:1736271620.870865:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7007 00000100:00100000:0.0:1736271620.870866:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024069888:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271620.870868:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070016 00000100:00100000:2.0:1736271620.870880:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00080000:3.0:1736271620.870880:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271620.870882:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271620.870883:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024070016:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271620.870885:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024069824:0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271620.870889:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271620.870897:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024069952:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271620.870910:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024070016:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (137us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271620.870914:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00080000:3.0:1736271620.870926:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271620.870929:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271620.870931:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024070016:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271621.418417:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271622.420462:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271623.422458:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271624.424462:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271624.566435:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024070144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271624.566442:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271624.566459:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024070080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271624.566495:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271624.566591:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070144 00000100:00100000:3.0:1736271624.566595:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271624.566632:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070080 00000100:00100000:2.0:1736271624.566649:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5806 00000100:00100000:2.0:1736271624.566654:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b358980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024070144:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271624.566661:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5807 00000100:00100000:0.0:1736271624.566666:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934eaf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024070080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271624.566678:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:0.0:1736271624.566680:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271624.566711:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934eaf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024070080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271624.566718:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5807 00000100:00100000:2.0:1736271624.566732:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b358980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024070144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271624.566734:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024070080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271624.566743:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5806 00000100:00100000:1.0:1736271624.566775:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024070144:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271625.426423:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271625.644686:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271625.644732:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271625.644759:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969472 00000100:00100000:0.0:1736271625.644769:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271625.644796:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969536 00000100:00100000:2.0:1736271625.644802:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 212 00000100:00100000:0.0:1736271625.644805:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969600 00000100:00100000:2.0:1736271625.644806:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058969472:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271625.644823:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 699 00000100:00100000:3.0:1736271625.644828:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b35f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058969600:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271625.644829:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 934 00000100:00100000:0.0:1736271625.644833:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b35d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058969536:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271625.644845:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271625.644859:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058969472:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 51us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271625.644859:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b35f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058969600:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 31us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271625.644866:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 212 00000100:00100000:3.0:1736271625.644866:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 699 00000100:00100000:0.0:1736271625.644868:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b35d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058969536:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 34us (136us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271625.644882:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 934 00000100:00080000:0.0:1736271625.878438:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271625.878445:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271625.878448:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271625.878453:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8406 00000100:00080000:0.0:1736271625.878456:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271625.878462:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271625.878467:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024070208:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271625.878480:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b35d580 x1820604024070272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271625.878519:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271625.878522:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1736271625.878522:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271625.878524:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1736271625.878534:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271625.878537:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8406 00000100:00080000:0.0:1736271625.878538:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00100000:1.0:1736271625.878538:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024070336:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271625.878542:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271625.878549:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070208 00000100:00100000:0.0:1736271625.878551:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b35b900 x1820604024070400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271625.878556:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024070272:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271625.878566:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271625.878568:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271625.878569:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271625.878570:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271625.878572:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8406 00000100:00080000:0.0:1736271625.878574:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271625.878576:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271625.878576:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736271625.878582:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024070464:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271625.878584:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1736271625.878585:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b571300 x1820604024070528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271625.878588:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024070208:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271625.878595:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070336 00000100:00100000:3.0:1736271625.878600:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271625.878606:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271625.878613:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070464 00000100:00080000:0.0:1736271625.878615:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271625.878616:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271625.878619:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8406 00000100:00080000:0.0:1736271625.878620:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00100000:2.0:1736271625.878620:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024070208:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271625.878621:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00080000:0.0:1736271625.878622:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271625.878624:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024070336:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271625.878624:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1736271625.878627:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1736271625.878630:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b574280 x1820604024070720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271625.878631:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934eed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024070464:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271625.878645:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024070336:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271625.878647:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b573900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024070656:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271625.878649:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:3.0:1736271625.878660:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934eed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024070464:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (59us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271625.878665:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1736271625.878670:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024070336:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271625.878674:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024070464:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271625.878677:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271625.878682:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271625.878688:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070656 00000100:00100000:2.0:1736271625.878694:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070272 00000100:00100000:1.0:1736271625.878699:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7008 00000100:00100000:1.0:1736271625.878701:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b576880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024070656:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271625.878704:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:2.0:1736271625.878706:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934edf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024070272:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271625.878706:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b35b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024070400:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271625.878707:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024070208:0@lo:400:kworker/u8:2.0 00010000:02000000:2.0:1736271625.878714:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271625.878716:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b576880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024070656:12345-0@lo:400:kworker/u8:2.0 Request processed in 14us (40us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271625.878719:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7008 00000100:00100000:3.0:1736271625.878726:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271625.878727:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5776c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024070592:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271625.878735:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b573900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024070656:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271625.878736:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934edf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024070272:12345-0@lo:38:kworker/u8:2.0 Request processed in 30us (55us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271625.878740:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1736271625.878741:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b571300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024070528:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271625.878745:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070400 00000100:00100000:1.0:1736271625.878746:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271625.878752:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:2.0:1736271625.878754:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aae6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024070400:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271625.878757:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271625.878759:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271625.878764:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070592 00000100:00100000:2.0:1736271625.878768:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aae6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024070400:12345-0@lo:38:kworker/u8:2.0 Request processed in 14us (43us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271625.878769:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b574280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024070720:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271625.878777:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:3.0:1736271625.878785:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271625.878786:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7009 00000100:00100000:1.0:1736271625.878788:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024070592:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271625.878795:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070528 00000100:00100000:2.0:1736271625.878805:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112781 00000100:00100000:2.0:1736271625.878808:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aae04c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024070528:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271625.878811:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271625.878812:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024070592:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (66us total) trans 0 rc 0/0 00010000:02000000:2.0:1736271625.878813:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736271625.878813:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271625.878816:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024070272:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271625.878817:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7009 00000100:00100000:0.0:1736271625.878822:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b5776c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024070592:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271625.878832:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271625.878833:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aae04c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024070528:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (75us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736271625.878834:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271625.878836:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b35b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024070400:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271625.878838:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112781 00000100:00080000:3.0:1736271625.878850:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271625.878851:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070720 00000100:00080000:3.0:1736271625.878852:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271625.878854:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b571300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024070528:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271625.878872:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:2.0:1736271625.878875:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb904c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024070720:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271625.878880:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271625.878898:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb904c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024070720:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (114us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271625.878901:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00080000:3.0:1736271625.878908:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271625.878910:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271625.878912:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b574280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024070720:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271626.428436:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271627.430440:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:0.0:1736271627.559370:0:19949:0:(genops.c:1786:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 64 seconds. The obd refcount = 4. Is it stuck? 00000020:02000400:0.0:1736271627.563296:0:19949:0:(genops.c:1752:print_export_data()) lustre-MDT0000: UNLINKED ffff88008faa8000 64bb3b11-afd7-4230-a38c-2a374f07ba02 192.168.203.38@tcp 1 (0 0 0) 1 0 1 0: (null) 523986010115 stale:0 00010000:00010000:1.0:1736271628.432499:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271629.434449:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271629.574466:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1736271629.574488:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb90980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024070848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271629.574542:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271629.574565:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024070784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271629.574576:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271629.574597:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070848 00000100:00100000:2.0:1736271629.574627:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070784 00000100:00100000:0.0:1736271629.574641:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5808 00000100:00100000:0.0:1736271629.574645:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024070848:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271629.574645:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5809 00000100:00100000:2.0:1736271629.574648:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846484c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024070784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271629.574666:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271629.574666:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271629.574698:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024070848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271629.574701:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846484c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024070784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271629.574702:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5808 00000100:00100000:2.0:1736271629.574707:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5809 00000100:00100000:1.0:1736271629.574714:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb90980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024070848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271629.574724:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024070784:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271630.436455:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271630.652522:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271630.652564:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271630.652589:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969664 00000100:00100000:0.0:1736271630.652605:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271630.652625:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969792 00000100:00100000:2.0:1736271630.652629:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 214 00000100:00100000:0.0:1736271630.652634:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969728 00000100:00100000:2.0:1736271630.652639:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058969664:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271630.652649:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 702 00000100:00100000:1.0:1736271630.652651:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5776c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058969792:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271630.652655:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 938 00000100:00100000:0.0:1736271630.652659:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058969728:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271630.652670:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271630.652686:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5776c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058969792:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 34us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271630.652689:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058969664:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 48us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271630.652690:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 702 00000100:00100000:0.0:1736271630.652693:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058969728:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 34us (89us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271630.652695:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 214 00000100:00100000:0.0:1736271630.652699:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 938 00000100:00080000:0.0:1736271630.886434:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271630.886440:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271630.886442:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271630.886460:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8411 00000100:00080000:0.0:1736271630.886464:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271630.886468:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271630.886477:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024070912:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271630.886483:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b573440 x1820604024070976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271630.886518:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271630.886520:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271630.886521:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271630.886524:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8411 00000100:00080000:0.0:1736271630.886525:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271630.886528:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271630.886534:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b571c80 x1820604024071104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271630.886539:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271630.886543:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271630.886545:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b573440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024070976:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271630.886546:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271630.886547:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271630.886549:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8411 00000100:00080000:0.0:1736271630.886550:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271630.886552:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271630.886558:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b5717c0 x1820604024071232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271630.886576:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271630.886578:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b576d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024071296:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271630.886589:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024071040:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271630.886590:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271630.886593:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271630.886593:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271630.886595:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8411 00000100:00100000:3.0:1736271630.886595:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b571c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024071104:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271630.886600:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271630.886602:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271630.886609:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b5750c0 x1820604024071424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271630.886609:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271630.886615:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271630.886620:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b573dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024071168:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271630.886629:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271630.886631:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071296 00000100:00100000:2.0:1736271630.886634:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024071360:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271630.886634:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024071232:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271630.886638:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271630.886651:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7010 00000100:00100000:0.0:1736271630.886656:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d1c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024071296:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271630.886657:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271630.886657:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271630.886660:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271630.886668:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5750c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024071424:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271630.886680:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070976 00000100:00100000:3.0:1736271630.886684:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271630.886685:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071232 00000100:00100000:0.0:1736271630.886692:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d1c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024071296:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271630.886696:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7010 00000100:00100000:1.0:1736271630.886696:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071104 00000100:00100000:1.0:1736271630.886701:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071168 00000100:00100000:2.0:1736271630.886702:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112782 00000100:00100000:0.0:1736271630.886706:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071360 00000100:00100000:2.0:1736271630.886706:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb92600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024071232:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271630.886711:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071040 00000100:00100000:3.0:1736271630.886713:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071424 00010000:02000000:2.0:1736271630.886717:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271630.886718:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1736271630.886719:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7011 00000100:00100000:0.0:1736271630.886721:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024071360:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271630.886722:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024071168:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271630.886728:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1736271630.886731:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084648e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024071040:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271630.886745:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024071360:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271630.886747:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb92600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024071232:12345-0@lo:38:kworker/u8:2.0 Request processed in 40us (92us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271630.886750:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7011 00000100:00100000:2.0:1736271630.886753:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112782 00000100:00100000:1.0:1736271630.886754:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024071168:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271630.886759:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1736271630.886760:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084648e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024071040:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271630.886765:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1736271630.886769:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:0.0:1736271630.886772:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb91c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024070976:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271630.886778:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271630.886782:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024070912 00000100:00100000:1.0:1736271630.886783:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:1.0:1736271630.886785:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb92140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024071104:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271630.886788:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00010000:02000000:1.0:1736271630.886791:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271630.886791:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb92ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024071424:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271630.886797:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb91c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024070976:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (221us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271630.886801:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1736271630.886802:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00010000:02000000:3.0:1736271630.886803:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271630.886805:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024070912:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271630.886808:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb92140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024071104:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (193us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271630.886813:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00100000:3.0:1736271630.886824:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb92ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024071424:12345-0@lo:38:kworker/u8:2.0 Request processed in 33us (140us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271630.886830:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:1.0:1736271630.886843:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b573dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024071168:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271630.886843:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024070912:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271630.886847:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024070912:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271630.886849:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1736271630.886856:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b570e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024071040:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271630.886880:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b572ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024071360:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271630.886881:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271630.886901:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271630.886905:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b5717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024071232:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271630.886915:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271630.886916:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271630.886918:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b5750c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024071424:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271630.886924:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b576d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024071296:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271630.886925:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271630.886926:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271630.886928:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b573440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024070976:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271630.886934:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271630.886936:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271630.886938:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b571c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024071104:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271631.438443:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271632.440463:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271633.442435:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271634.444434:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271634.582462:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024071552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271634.582462:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024071488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271634.582517:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271634.582558:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271634.582567:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071488 00000100:00100000:3.0:1736271634.582586:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071552 00000100:00100000:2.0:1736271634.582600:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5810 00000100:00100000:2.0:1736271634.582605:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb92f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024071488:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271634.582608:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5811 00000100:00100000:3.0:1736271634.582610:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024071552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271634.582631:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:3.0:1736271634.582631:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736271634.582660:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024071552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271634.582662:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb92f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024071488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271634.582666:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5811 00000100:00100000:2.0:1736271634.582674:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5810 00000100:00100000:0.0:1736271634.582681:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024071552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271634.582705:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024071488:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271635.446448:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271635.660573:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271635.660620:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271635.660650:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969856 00000100:00100000:0.0:1736271635.660669:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271635.660707:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 216 00000100:00100000:3.0:1736271635.660714:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058969856:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271635.660733:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969920 00000100:00100000:2.0:1736271635.660761:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058969984 00000100:00100000:0.0:1736271635.660777:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 705 00000100:00100000:0.0:1736271635.660781:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058969984:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271635.660781:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058969856:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 66us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271635.660787:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 942 00000100:00100000:3.0:1736271635.660788:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 216 00000100:00100000:2.0:1736271635.660792:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058969920:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:0.0:1736271635.660808:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058969984:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 27us (141us total) trans 0 rc 0/0 00010000:02000000:2.0:1736271635.660808:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271635.660813:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 705 00000100:00100000:2.0:1736271635.660835:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058969920:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 42us (215us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271635.660841:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 942 00000100:00080000:0.0:1736271635.894483:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271635.894491:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271635.894495:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271635.894502:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8416 00000100:00080000:0.0:1736271635.894508:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271635.894513:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271635.894518:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b574c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024071616:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271635.894536:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b5704c0 x1820604024071680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271635.894575:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736271635.894577:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271635.894578:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271635.894579:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271635.894582:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8416 00000100:00080000:0.0:1736271635.894584:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271635.894588:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271635.894595:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5763c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024071744:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271635.894612:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b574740 x1820604024071808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271635.894621:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071616 00000100:00100000:1.0:1736271635.894628:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271635.894629:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5704c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024071680:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271635.894632:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271635.894635:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271635.894636:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271635.894638:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8416 00000100:00080000:0.0:1736271635.894640:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271635.894643:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271635.894652:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b575a40 x1820604024071936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271635.894656:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271635.894662:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1736271635.894667:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024071616:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271635.894668:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b575580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024071872:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271635.894669:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b574740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024071808:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271635.894675:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271635.894678:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271635.894679:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271635.894682:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8416 00000100:00080000:0.0:1736271635.894684:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271635.894687:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271635.894691:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271635.894695:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b577200 x1820604024072128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271635.894700:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071744 00000100:00100000:0.0:1736271635.894715:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024072064:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271635.894719:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736271635.894721:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024071616:12345-0@lo:400:kworker/u8:2.0 Request processed in 53us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271635.894725:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071680 00000100:00100000:3.0:1736271635.894727:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1736271635.894731:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024072000:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271635.894737:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071872 00000100:00100000:0.0:1736271635.894747:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271635.894753:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:2.0:1736271635.894763:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024071744:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271635.894767:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1736271635.894771:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846497c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024071872:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271635.894782:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b574c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024071616:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271635.894797:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024071744:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271635.894797:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846497c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024071872:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271635.894802:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1736271635.894805:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1736271635.894814:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:1.0:1736271635.894818:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024071680:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271635.894831:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072064 00010000:02000000:1.0:1736271635.894831:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271635.894838:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271635.894875:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7012 00000100:00100000:0.0:1736271635.894879:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024072064:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271635.894886:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071808 00000100:00100000:1.0:1736271635.894892:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024071680:12345-0@lo:38:kworker/u8:2.0 Request processed in 73us (236us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271635.894893:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b575a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024071936:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271635.894899:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:3.0:1736271635.894902:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:3.0:1736271635.894905:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d550980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024071808:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271635.894912:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271635.894913:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024072064:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271635.894919:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271635.894925:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7012 00000100:00100000:1.0:1736271635.894925:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b5763c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024071744:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271635.894932:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b577200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024072128:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271635.894936:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d550980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024071808:12345-0@lo:38:kworker/u8:2.0 Request processed in 31us (99us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271635.894940:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1736271635.894942:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271635.894953:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271635.894957:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024071936 00000100:00100000:0.0:1736271635.894962:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b575580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024071872:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271635.894967:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112783 00000100:00080000:2.0:1736271635.894968:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271635.894970:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271635.894970:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024071936:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271635.894974:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b5704c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024071680:0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271635.894974:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1736271635.894981:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271635.894983:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271635.894985:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b574740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024071808:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271635.894986:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024071936:12345-0@lo:38:kworker/u8:2.0 Request processed in 16us (68us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271635.894989:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112783 00000100:00100000:0.0:1736271635.894994:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072000 00000100:00100000:3.0:1736271635.894996:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072128 00000100:00100000:3.0:1736271635.895002:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:3.0:1736271635.895004:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024072128:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271635.895005:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271635.895007:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00010000:02000000:3.0:1736271635.895007:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271635.895009:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7013 00000100:00100000:2.0:1736271635.895009:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b575a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024071936:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271635.895012:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b574c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024072000:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271635.895016:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024072128:12345-0@lo:38:kworker/u8:2.0 Request processed in 12us (64us total) trans 0 rc -19/-19 00000100:00080000:2.0:1736271635.895017:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271635.895019:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271635.895019:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:2.0:1736271635.895021:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b577200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024072128:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271635.895049:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b574c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024072000:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271635.895054:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7013 00000100:00100000:1.0:1736271635.895062:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b572140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024072000:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271635.895075:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b570980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024072064:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271636.448461:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271637.450457:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271638.452478:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271639.454439:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271639.590442:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271639.590444:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271639.590456:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024072192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271639.590456:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024072256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271639.590505:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271639.590523:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271639.590553:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072192 00000100:00100000:3.0:1736271639.590578:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072256 00000100:00100000:2.0:1736271639.590599:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5812 00000100:00100000:2.0:1736271639.590602:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b575580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024072192:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271639.590607:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5813 00000100:00100000:3.0:1736271639.590609:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024072256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271639.590621:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:3.0:1736271639.590621:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271639.590650:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b575580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024072192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271639.590651:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024072256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271639.590654:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5812 00000100:00100000:3.0:1736271639.590656:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5813 00000100:00100000:0.0:1736271639.590672:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b570980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024072192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271639.590672:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024072256:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271640.456461:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271640.668570:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271640.668619:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271640.668651:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970048 00000100:00100000:2.0:1736271640.668687:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970176 00000100:00100000:3.0:1736271640.668687:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 218 00000100:00100000:3.0:1736271640.668693:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058970048:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271640.668695:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271640.668724:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970112 00000100:00100000:2.0:1736271640.668737:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 708 00000100:00100000:2.0:1736271640.668741:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058970176:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271640.668744:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 946 00000100:00100000:0.0:1736271640.668748:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058970112:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:3.0:1736271640.668749:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058970048:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 56us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271640.668755:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 218 00010000:02000000:0.0:1736271640.668760:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271640.668772:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058970176:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 30us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271640.668779:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 708 00000100:00100000:0.0:1736271640.668787:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058970112:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 38us (93us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271640.668793:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 946 00000100:00080000:0.0:1736271640.902441:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271640.902458:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271640.902461:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271640.902466:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8421 00000100:00080000:0.0:1736271640.902469:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271640.902474:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271640.902476:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5750c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024072320:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271640.902491:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b5717c0 x1820604024072384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271640.902529:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271640.902532:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271640.902533:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271640.902536:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8421 00000100:00100000:1.0:1736271640.902536:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271640.902538:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271640.902541:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271640.902548:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b572ac0 x1820604024072512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271640.902561:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271640.902563:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271640.902564:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271640.902567:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8421 00000100:00080000:0.0:1736271640.902568:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271640.902570:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271640.902573:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024072384:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271640.902576:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b576d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024072448:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271640.902578:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b573dc0 x1820604024072640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271640.902597:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271640.902599:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271640.902601:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271640.902605:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271640.902608:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8421 00000100:00080000:0.0:1736271640.902610:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271640.902612:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271640.902616:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072320 00000100:00100000:1.0:1736271640.902618:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271640.902621:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b572140 x1820604024072832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271640.902623:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024072576:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271640.902639:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271640.902646:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072448 00000100:00100000:3.0:1736271640.902646:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1736271640.902651:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024072320:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271640.902654:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b571300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024072768:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271640.902655:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b574280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024072704:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271640.902667:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072576 00000100:00100000:1.0:1736271640.902679:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271640.902680:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1736271640.902684:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024072448:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271640.902699:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271640.902700:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024072320:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271640.902706:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1736271640.902709:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b5750c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024072320:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271640.902737:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:2.0:1736271640.902741:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024072576:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271640.902743:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072768 00000100:00100000:3.0:1736271640.902758:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072704 00000100:00100000:3.0:1736271640.902768:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7014 00000100:00100000:3.0:1736271640.902771:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024072768:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271640.902775:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024072448:12345-0@lo:400:kworker/u8:2.0 Request processed in 90us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271640.902778:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b576d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024072448:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271640.902782:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1736271640.902789:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b570e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024072576:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271640.902789:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024072576:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271640.902795:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1736271640.902797:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024072768:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271640.902803:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7014 00000100:00100000:1.0:1736271640.902806:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b571300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024072768:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271640.902811:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7015 00000100:00100000:0.0:1736271640.902815:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024072704:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271640.902851:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271640.902859:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024072704:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271640.902863:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072384 00000100:00100000:3.0:1736271640.902864:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024072512:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271640.902865:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7015 00000100:00100000:3.0:1736271640.902880:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271640.902884:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072512 00000100:00100000:3.0:1736271640.902889:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b573dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024072640:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271640.902895:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:2.0:1736271640.902898:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb93440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024072384:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271640.902902:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:3.0:1736271640.902903:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271640.902905:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb93900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024072512:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271640.902907:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271640.902911:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024072832:0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271640.902912:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271640.902915:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072640 00000100:00100000:1.0:1736271640.902931:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112784 00000100:00100000:1.0:1736271640.902935:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb93dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024072640:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271640.902937:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271640.902940:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb93900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024072512:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (60us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271640.902941:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb93440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024072384:12345-0@lo:38:kworker/u8:2.0 Request processed in 42us (90us total) trans 0 rc -19/-19 00010000:02000000:1.0:1736271640.902942:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271640.902945:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1736271640.902949:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:0.0:1736271640.902956:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072832 00000100:00080000:3.0:1736271640.902963:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271640.902964:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb93dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024072640:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (60us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736271640.902966:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271640.902967:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:1.0:1736271640.902969:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112784 00000100:00100000:3.0:1736271640.902969:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b5717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024072384:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271640.902970:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b574280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024072704:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271640.902971:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb94280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024072832:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271640.902977:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271640.902979:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271640.902981:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b572ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024072512:0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271640.902982:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736271640.902998:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271640.903000:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271640.903002:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024072832:12345-0@lo:38:kworker/u8:2.0 Request processed in 31us (65us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271640.903003:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b573dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024072640:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271640.903008:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00080000:3.0:1736271640.903009:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271640.903010:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271640.903012:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b572140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024072832:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271641.458448:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271642.460427:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271643.462453:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271644.464436:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271644.598422:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024072896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271644.598422:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b577200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024072960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271644.598474:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271644.598516:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271644.598521:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072896 00000100:00100000:2.0:1736271644.598558:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024072960 00000100:00100000:2.0:1736271644.598573:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5814 00000100:00100000:0.0:1736271644.598577:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5815 00000100:00100000:2.0:1736271644.598577:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b575a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024072896:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271644.598581:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024072960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271644.598597:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271644.598597:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271644.598622:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024072960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271644.598627:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5815 00000100:00100000:2.0:1736271644.598634:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b575a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024072896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271644.598639:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5814 00000100:00100000:1.0:1736271644.598644:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b577200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024072960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271644.598650:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024072896:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271645.466428:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271645.676516:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271645.676544:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271645.676571:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271645.676575:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970240 00000100:00100000:0.0:1736271645.676587:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970368 00000100:00100000:2.0:1736271645.676622:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 220 00000100:00100000:0.0:1736271645.676624:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970304 00000100:00100000:2.0:1736271645.676628:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058970240:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271645.676630:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 711 00000100:00100000:1.0:1736271645.676636:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b574740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058970368:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271645.676639:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 950 00000100:00100000:0.0:1736271645.676642:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5704c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058970304:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271645.676651:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271645.676680:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058970240:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 52us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271645.676681:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5704c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058970304:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 37us (109us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271645.676681:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b574740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058970368:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 44us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271645.676684:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 950 00000100:00100000:1.0:1736271645.676687:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 711 00000100:00100000:2.0:1736271645.676687:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 220 00000100:00080000:0.0:1736271645.910426:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271645.910444:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271645.910446:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271645.910452:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8426 00000100:00080000:0.0:1736271645.910456:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271645.910460:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271645.910462:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5763c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024073024:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271645.910480:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b577200 x1820604024073088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271645.910514:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271645.910517:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271645.910518:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271645.910521:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8426 00000100:00080000:0.0:1736271645.910522:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271645.910526:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271645.910528:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024073152:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271645.910530:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271645.910533:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b577200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024073088:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271645.910535:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b573dc0 x1820604024073216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271645.910555:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271645.910555:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271645.910557:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271645.910558:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271645.910560:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8426 00000100:00080000:0.0:1736271645.910562:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271645.910564:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271645.910570:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b5717c0 x1820604024073344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271645.910576:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073024 00000100:00100000:2.0:1736271645.910577:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736271645.910584:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b574280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024073408:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271645.910590:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271645.910591:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1736271645.910592:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271645.910595:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b571300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024073472:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271645.910597:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271645.910598:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00080000:0.0:1736271645.910600:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8426 00000100:00080000:0.0:1736271645.910601:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1736271645.910602:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024073024:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271645.910604:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271645.910608:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271645.910613:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b570e40 x1820604024073536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271645.910624:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073408 00000100:00100000:2.0:1736271645.910625:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024073280:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271645.910629:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024073024:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271645.910633:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1736271645.910640:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7016 00000100:00100000:1.0:1736271645.910643:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024073408:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271645.910645:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b5763c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024073024:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271645.910649:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271645.910662:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073152 00000100:00100000:0.0:1736271645.910669:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073088 00000100:00100000:1.0:1736271645.910670:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024073408:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (63us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271645.910672:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b573dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024073216:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271645.910674:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7016 00000100:00100000:3.0:1736271645.910684:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271645.910685:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271645.910687:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1736271645.910691:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084649300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024073152:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271645.910694:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073472 00000100:00100000:0.0:1736271645.910695:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073216 00000100:00100000:3.0:1736271645.910697:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024073344:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271645.910702:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7017 00000100:00100000:1.0:1736271645.910704:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024073472:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271645.910708:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1736271645.910711:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb94740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024073088:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271645.910712:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271645.910717:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084649300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024073152:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (162us total) trans 0 rc 0/0 00010000:02000000:0.0:1736271645.910721:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271645.910721:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024073472:12345-0@lo:400:kworker/u8:2.0 Request processed in 16us (36us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271645.910721:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024073536:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271645.910722:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1736271645.910724:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7017 00000100:00100000:2.0:1736271645.910729:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1736271645.910731:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb94c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024073216:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271645.910734:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073344 00010000:02000000:2.0:1736271645.910736:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271645.910736:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271645.910746:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112785 00000100:00100000:1.0:1736271645.910750:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb950c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024073344:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271645.910752:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271645.910754:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024073088:12345-0@lo:38:kworker/u8:2.0 Request processed in 42us (104us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736271645.910754:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00010000:02000000:1.0:1736271645.910756:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271645.910757:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b577200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024073088:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271645.910759:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024073216:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (75us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271645.910760:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:2.0:1736271645.910762:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1736271645.910768:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073536 00000100:00080000:3.0:1736271645.910772:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271645.910774:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271645.910775:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb950c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024073344:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (63us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271645.910776:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b573dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024073216:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271645.910777:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:2.0:1736271645.910778:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb95580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024073536:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271645.910782:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736271645.910783:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271645.910800:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271645.910802:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b5717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024073344:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271645.910810:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb95580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024073536:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (73us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736271645.910811:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271645.910813:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271645.910814:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:3.0:1736271645.910815:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b570e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024073536:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271645.910816:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112785 00000100:00100000:2.0:1736271645.910828:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271645.910844:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073280 00000100:00100000:2.0:1736271645.910849:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b574280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024073408:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271645.910856:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b571300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024073472:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271645.910864:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b572140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024073152:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271645.910868:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1736271645.910870:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024073280:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271645.910902:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024073280:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271645.910907:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:2.0:1736271645.910927:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b572ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024073280:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271646.468443:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271647.470418:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271648.472453:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271649.474449:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271649.606408:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271649.606421:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5763c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024073600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271649.606421:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb14280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024073664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271649.606471:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271649.606494:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271649.606519:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073600 00000100:00100000:2.0:1736271649.606524:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073664 00000100:00100000:2.0:1736271649.606559:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5816 00000100:00100000:1.0:1736271649.606564:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5817 00000100:00100000:2.0:1736271649.606564:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084649c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024073664:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271649.606567:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b576d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024073600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736271649.606585:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271649.606595:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736271649.606608:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b576d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024073600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271649.606612:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5817 00000100:00100000:0.0:1736271649.606629:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b5763c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024073600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271649.606629:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084649c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024073664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271649.606634:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5816 00000100:00100000:1.0:1736271649.606650:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb14280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024073664:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271650.476423:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271650.684549:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271650.684608:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271650.684637:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970432 00000100:00100000:0.0:1736271650.684653:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271650.684673:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970560 00000100:00100000:0.0:1736271650.684690:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970496 00000100:00100000:3.0:1736271650.684693:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 222 00000100:00100000:3.0:1736271650.684699:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058970432:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271650.684702:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 714 00000100:00100000:2.0:1736271650.684706:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5763c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058970560:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271650.684709:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 954 00000100:00100000:0.0:1736271650.684713:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5750c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058970496:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271650.684725:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271650.684815:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5763c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058970560:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 107us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271650.684815:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058970432:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 116us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271650.684819:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5750c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058970496:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 105us (167us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271650.684822:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 714 00000100:00100000:3.0:1736271650.684823:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 222 00000100:00100000:0.0:1736271650.684826:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 954 00000100:00080000:0.0:1736271650.918423:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271650.918430:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271650.918433:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271650.918438:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8431 00000100:00080000:0.0:1736271650.918441:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271650.918446:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271650.918462:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024073728:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271650.918464:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b572140 x1820604024073792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271650.918507:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271650.918511:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271650.918512:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271650.918515:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8431 00000100:00080000:0.0:1736271650.918516:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271650.918519:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271650.918524:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024073792:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271650.918525:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b571300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024073856:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271650.918526:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b574280 x1820604024073920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271650.918527:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271650.918538:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271650.918551:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271650.918552:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271650.918554:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8431 00000100:00080000:0.0:1736271650.918556:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1736271650.918556:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271650.918558:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271650.918560:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024073984:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271650.918568:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b5717c0 x1820604024074048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271650.918568:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073728 00000100:00100000:2.0:1736271650.918581:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b574280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024073920:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271650.918583:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271650.918590:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271650.918591:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00080000:0.0:1736271650.918593:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271650.918594:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271650.918594:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024073728:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271650.918597:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8431 00000100:00080000:0.0:1736271650.918598:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271650.918601:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271650.918601:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271650.918610:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b14c00 x1820604024074240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271650.918610:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b573dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024074112:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271650.918614:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024074048:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271650.918618:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024073728:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271650.918623:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1736271650.918632:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073792 00000100:00100000:1.0:1736271650.918634:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271650.918634:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271650.918649:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073984 00000100:00100000:3.0:1736271650.918649:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b577200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024074176:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271650.918652:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024074240:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271650.918660:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074112 00000100:00100000:0.0:1736271650.918664:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073920 00000100:00100000:3.0:1736271650.918667:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271650.918670:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271650.918674:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1736271650.918677:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024073984:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271650.918680:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074176 00000100:00100000:3.0:1736271650.918689:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b572ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024073728:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271650.918693:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7018 00000100:00100000:2.0:1736271650.918693:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074240 00000100:00100000:1.0:1736271650.918697:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024074112:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271650.918706:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:2.0:1736271650.918709:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb12ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024073792:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271650.918711:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024073984:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271650.918713:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7019 00000100:00100000:0.0:1736271650.918716:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1736271650.918717:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024074176:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:2.0:1736271650.918719:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271650.918724:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024074112:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271650.918729:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1736271650.918729:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7018 00000100:00100000:0.0:1736271650.918731:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb12140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024073920:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271650.918738:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271650.918745:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb12ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024073792:12345-0@lo:38:kworker/u8:2.0 Request processed in 35us (189us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271650.918745:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024074176:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271650.918747:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074048 00000100:00100000:3.0:1736271650.918750:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7019 00000100:00100000:2.0:1736271650.918774:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1736271650.918782:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb12140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024073920:12345-0@lo:38:kworker/u8:2.0 Request processed in 49us (179us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271650.918787:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:2.0:1736271650.918790:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb16d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024074240:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271650.918791:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b577200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024074176:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271650.918794:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1736271650.918794:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112786 00010000:02000000:2.0:1736271650.918796:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271650.918798:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024074048:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271650.918812:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271650.918817:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb16d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024074240:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (146us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271650.918822:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:1.0:1736271650.918833:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024074048:12345-0@lo:38:kworker/u8:2.0 Request processed in 35us (200us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271650.918839:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112786 00000100:00080000:2.0:1736271650.918850:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271650.918852:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271650.918855:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024074240:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271650.918860:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b570e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024073984:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271650.918863:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271650.918865:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271650.918867:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b574280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024073920:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271650.918874:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271650.918874:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271650.918876:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271650.918878:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b5717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024074048:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271650.918884:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271650.918885:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271650.918887:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b572140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024073792:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271650.918902:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b573dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024074112:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271650.918910:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024073856 00000100:00100000:3.0:1736271650.918935:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1736271650.918939:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024073856:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271650.918968:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024073856:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271650.918973:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1736271650.918981:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b571300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024073856:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271651.478437:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271652.480442:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271653.482437:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271654.484438:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271654.614415:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024074304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271654.614440:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb117c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024074368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271654.614481:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271654.614510:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074304 00000100:00100000:2.0:1736271654.614541:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5818 00000100:00100000:2.0:1736271654.614554:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024074304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271654.614577:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271654.614599:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271654.614622:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024074304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271654.614657:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074368 00000100:00100000:2.0:1736271654.614679:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5818 00000100:00100000:0.0:1736271654.614693:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5819 00000100:00100000:0.0:1736271654.614697:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb95f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024074368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271654.614712:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271654.614776:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb95f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024074368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271654.614782:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5819 00000100:00100000:3.0:1736271654.614792:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb117c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024074368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271654.614811:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024074304:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271655.486440:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271655.692579:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271655.692623:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271655.692659:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970624 00000100:00100000:1.0:1736271655.692700:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970752 00000100:00100000:0.0:1736271655.692705:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271655.692718:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 224 00000100:00100000:2.0:1736271655.692735:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058970624:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271655.692745:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970688 00000100:00100000:0.0:1736271655.692749:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 717 00000100:00100000:0.0:1736271655.692754:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b17200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058970752:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271655.692761:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 958 00000100:00100000:1.0:1736271655.692765:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b15580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058970688:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271655.692776:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271655.692802:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b17200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058970752:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 48us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271655.692809:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 717 00000100:00100000:1.0:1736271655.692816:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b15580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058970688:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 50us (111us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271655.692820:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058970624:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 84us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271655.692823:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 958 00000100:00100000:2.0:1736271655.692827:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 224 00000100:00080000:0.0:1736271655.926401:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271655.926407:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271655.926409:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271655.926415:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8436 00000100:00080000:0.0:1736271655.926418:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271655.926423:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271655.926435:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736271655.926449:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024074432:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271655.926450:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b13440 x1820604024074496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271655.926473:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271655.926475:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271655.926476:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271655.926478:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8436 00000100:00080000:0.0:1736271655.926479:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271655.926484:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271655.926487:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271655.926489:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b11300 x1820604024074624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271655.926497:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024074560:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271655.926503:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271655.926504:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736271655.926505:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024074496:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271655.926507:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271655.926509:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271655.926511:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8436 00000100:00080000:0.0:1736271655.926513:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271655.926515:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271655.926523:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b11c80 x1820604024074752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271655.926525:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736271655.926530:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b10e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024074688:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271655.926533:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271655.926542:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271655.926544:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1736271655.926545:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1736271655.926545:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074432 00000100:00080000:0.0:1736271655.926546:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271655.926547:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024074880:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271655.926548:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8436 00000100:00080000:0.0:1736271655.926550:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271655.926552:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271655.926559:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b14280 x1820604024074944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271655.926562:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271655.926567:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074560 00000100:00100000:3.0:1736271655.926573:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271655.926575:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1736271655.926579:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024074432:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271655.926580:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024074816:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271655.926587:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074688 00000100:00100000:3.0:1736271655.926588:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271655.926600:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074880 00000100:00100000:3.0:1736271655.926601:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074816 00000100:00100000:1.0:1736271655.926607:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1736271655.926610:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024074560:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271655.926617:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024074432:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271655.926618:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7020 00000100:00100000:0.0:1736271655.926620:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb963c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024074880:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271655.926623:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1736271655.926624:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7021 00000100:00100000:3.0:1736271655.926627:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb96d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024074816:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271655.926641:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024074560:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271655.926646:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:2.0:1736271655.926647:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271655.926651:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb963c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024074880:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271655.926654:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7020 00000100:00100000:3.0:1736271655.926654:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb96d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024074816:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (65us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271655.926657:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074496 00000100:00100000:3.0:1736271655.926658:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7021 00000100:00100000:2.0:1736271655.926660:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024074624:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271655.926669:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:0.0:1736271655.926672:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1736271655.926673:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb96880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024074688:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271655.926674:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb13900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024074496:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271655.926676:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271655.926676:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024074816:0@lo:400:kworker/u8:2.0 00010000:02000000:0.0:1736271655.926683:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271655.926686:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b11c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024074752:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271655.926690:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074624 00000100:00100000:1.0:1736271655.926696:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb96880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024074688:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271655.926699:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb13900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024074496:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (53us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271655.926701:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:3.0:1736271655.926704:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb13440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024074624:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271655.926705:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271655.926708:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00010000:02000000:3.0:1736271655.926710:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271655.926711:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:2.0:1736271655.926740:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024074944:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271655.926758:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074752 00000100:00100000:1.0:1736271655.926758:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024074560:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271655.926768:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271655.926768:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb13440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024074624:12345-0@lo:38:kworker/u8:2.0 Request processed in 63us (91us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271655.926770:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112787 00000100:00100000:0.0:1736271655.926772:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb11300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024074752:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271655.926777:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271655.926782:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00080000:2.0:1736271655.926783:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271655.926785:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271655.926788:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024074496:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271655.926792:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb11300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024074752:12345-0@lo:38:kworker/u8:2.0 Request processed in 19us (88us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271655.926792:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024074944 00000100:00100000:0.0:1736271655.926795:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112787 00000100:00080000:2.0:1736271655.926796:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271655.926798:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271655.926800:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024074624:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271655.926810:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:3.0:1736271655.926813:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024074944:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271655.926819:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1736271655.926820:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271655.926823:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271655.926825:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b11c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024074752:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271655.926838:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024074944:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (71us total) trans 0 rc -19/-19 00000100:00080000:2.0:1736271655.926839:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271655.926841:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271655.926843:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024074944:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271655.926843:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:3.0:1736271655.926859:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b10e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024074688:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271655.926861:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024074880:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271655.926868:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024074432:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271656.488448:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271657.490432:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271658.492459:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271659.494427:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271659.622438:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024075008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271659.622478:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736271659.622489:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb14280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024075072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271659.622499:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271659.622519:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271659.622529:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075008 00000100:00100000:2.0:1736271659.622542:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075072 00000100:00100000:0.0:1736271659.622557:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5820 00000100:00100000:0.0:1736271659.622562:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb97200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024075008:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271659.622562:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5821 00000100:00100000:2.0:1736271659.622566:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024075072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271659.622583:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271659.622596:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271659.622624:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb97200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024075008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271659.622629:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024075072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271659.622631:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5820 00000100:00100000:2.0:1736271659.622641:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5821 00000100:00100000:3.0:1736271659.622648:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024075008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271659.622677:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb14280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024075072:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271660.496444:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271660.700530:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271660.700562:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271660.700586:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271660.700602:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970816 00000100:00100000:0.0:1736271660.700606:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970880 00000100:00100000:1.0:1736271660.700611:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058970944 00000100:00100000:0.0:1736271660.700628:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 720 00000100:00100000:0.0:1736271660.700632:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058970944:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271660.700633:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 962 00000100:00100000:1.0:1736271660.700636:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058970880:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:2.0:1736271660.700642:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 226 00010000:02000000:1.0:1736271660.700646:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271660.700647:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058970816:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271660.700678:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058970944:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 46us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271660.700679:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058970880:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 42us (117us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271660.700681:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058970816:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 35us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271660.700683:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 720 00000100:00100000:1.0:1736271660.700685:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 962 00000100:00100000:2.0:1736271660.700703:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 226 00000100:00080000:0.0:1736271660.934373:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271660.934379:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271660.934381:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271660.934385:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8441 00000100:00080000:0.0:1736271660.934388:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271660.934392:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271660.934397:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b16d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024075136:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271660.934406:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b176c0 x1820604024075200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271660.934443:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271660.934447:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271660.934448:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271660.934448:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024075264:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271660.934451:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8441 00000100:00080000:0.0:1736271660.934453:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271660.934456:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271660.934459:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271660.934466:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b104c0 x1820604024075328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271660.934475:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b176c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024075200:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271660.934478:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271660.934482:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271660.934491:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271660.934492:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271660.934495:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8441 00000100:00080000:0.0:1736271660.934497:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00100000:1.0:1736271660.934499:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271660.934499:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075136 00000100:00080000:0.0:1736271660.934500:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271660.934504:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024075392:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271660.934508:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b13900 x1820604024075456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271660.934511:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271660.934530:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271660.934530:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024075328:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271660.934533:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271660.934533:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271660.934533:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00080000:0.0:1736271660.934534:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271660.934537:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8441 00000100:00080000:0.0:1736271660.934538:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00100000:2.0:1736271660.934538:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024075136:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271660.934540:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271660.934548:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b117c0 x1820604024075648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271660.934548:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271660.934556:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075264 00000100:00100000:3.0:1736271660.934560:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024075456:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271660.934567:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024075136:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271660.934569:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075200 00000100:00100000:2.0:1736271660.934572:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1736271660.934576:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271660.934579:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075392 00000100:00100000:0.0:1736271660.934584:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075328 00000100:00100000:1.0:1736271660.934587:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1736271660.934588:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b117c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024075648:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271660.934589:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b35b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024075264:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271660.934592:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1736271660.934596:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b35d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024075392:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271660.934596:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024075584:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271660.934603:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271660.934612:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b35b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024075264:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271660.934616:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:2.0:1736271660.934617:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271660.934623:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075648 00000100:00100000:3.0:1736271660.934624:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075456 00000100:00100000:1.0:1736271660.934627:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:0.0:1736271660.934629:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b35d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024075392:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271660.934629:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb976c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024075200:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271660.934634:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00010000:02000000:1.0:1736271660.934637:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271660.934640:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112788 00000100:00100000:2.0:1736271660.934641:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b16d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024075136:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271660.934644:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb90e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024075456:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271660.934645:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:0.0:1736271660.934648:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb91300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024075328:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271660.934651:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb976c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024075200:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (143us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271660.934653:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:02000000:0.0:1736271660.934654:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271660.934655:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00010000:02000000:3.0:1736271660.934656:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271660.934660:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1736271660.934662:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024075648:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271660.934663:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024075520:0@lo:400:kworker/u8:2.0 00010000:02000000:1.0:1736271660.934665:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271660.934672:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb91300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024075328:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (124us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271660.934679:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024075648:12345-0@lo:38:kworker/u8:2.0 Request processed in 16us (76us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271660.934682:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:3.0:1736271660.934683:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb90e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024075456:12345-0@lo:38:kworker/u8:2.0 Request processed in 38us (105us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271660.934684:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271660.934698:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1736271660.934703:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112788 00000100:00100000:1.0:1736271660.934716:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024075392:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271660.934721:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024075264:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271660.934721:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075584 00000100:00080000:3.0:1736271660.934729:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271660.934731:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271660.934734:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b117c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024075648:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271660.934735:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075520 00000100:00100000:2.0:1736271660.934740:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7022 00000100:00080000:3.0:1736271660.934741:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271660.934743:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024075584:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271660.934743:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271660.934745:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7023 00000100:00100000:3.0:1736271660.934745:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024075328:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271660.934748:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024075520:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271660.934751:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271660.934753:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271660.934755:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024075456:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271660.934761:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271660.934763:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271660.934764:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b176c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024075200:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271660.934769:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024075584:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271660.934774:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7022 00000100:00100000:1.0:1736271660.934775:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024075520:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271660.934780:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7023 00000100:00100000:2.0:1736271660.934792:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024075520:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271660.934800:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024075584:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271661.498444:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271662.500491:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271663.502840:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271664.504456:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271664.630459:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024075776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271664.630490:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024075712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271664.630517:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271664.630544:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271664.630566:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075776 00000100:00100000:1.0:1736271664.630580:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075712 00000100:00100000:0.0:1736271664.630593:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5822 00000100:00100000:0.0:1736271664.630597:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b13dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024075776:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271664.630606:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5823 00000100:00100000:1.0:1736271664.630610:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b35ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024075712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271664.630615:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:1.0:1736271664.630625:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271664.630646:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b13dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024075776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271664.630650:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5822 00000100:00100000:1.0:1736271664.630653:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b35ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024075712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271664.630658:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5823 00000100:00100000:1.0:1736271664.630718:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024075712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271664.630718:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024075776:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271665.506448:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271665.708443:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271665.708474:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271665.708512:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971008 00000100:00100000:1.0:1736271665.708531:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971136 00000100:00100000:0.0:1736271665.708548:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271665.708561:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 228 00000100:00100000:1.0:1736271665.708564:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971072 00000100:00100000:2.0:1736271665.708567:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058971008:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271665.708577:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 723 00000100:00100000:0.0:1736271665.708581:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 966 00000100:00100000:1.0:1736271665.708581:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058971136:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271665.708584:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b13900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058971072:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271665.708595:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271665.708619:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058971008:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 52us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271665.708623:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b13900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058971072:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 38us (76us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271665.708623:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058971136:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 41us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271665.708626:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 228 00000100:00100000:0.0:1736271665.708629:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 966 00000100:00100000:1.0:1736271665.708636:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 723 00000100:00080000:0.0:1736271665.942385:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271665.942391:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271665.942394:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271665.942399:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8446 00000100:00080000:0.0:1736271665.942402:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00100000:2.0:1736271665.942413:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1736271665.942416:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271665.942429:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024075840:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271665.942432:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b117c0 x1820604024075904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271665.942462:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271665.942466:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271665.942467:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271665.942470:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8446 00000100:00080000:0.0:1736271665.942471:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271665.942475:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271665.942479:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271665.942483:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b12600 x1820604024076032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271665.942488:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024075968:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271665.942493:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b117c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024075904:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271665.942501:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271665.942504:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271665.942504:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736271665.942504:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271665.942507:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8446 00000100:00080000:0.0:1736271665.942508:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271665.942510:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271665.942518:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b150c0 x1820604024076160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271665.942521:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271665.942528:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736271665.942534:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b16d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024076096:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271665.942547:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075840 00000100:00080000:0.0:1736271665.942550:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271665.942553:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271665.942553:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1736271665.942554:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736271665.942554:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271665.942556:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8446 00000100:00080000:0.0:1736271665.942557:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:1.0:1736271665.942559:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024076224:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271665.942560:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271665.942573:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b10e40 x1820604024076352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271665.942580:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1736271665.942581:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736271665.942582:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271665.942584:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024075840:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271665.942586:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024076288:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271665.942596:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075968 00000100:00100000:1.0:1736271665.942600:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076224 00000100:00100000:2.0:1736271665.942604:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271665.942618:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076096 00000100:00100000:1.0:1736271665.942618:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076288 00000100:00100000:3.0:1736271665.942618:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024075840:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271665.942626:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024075840:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271665.942629:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1736271665.942629:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7024 00000100:00100000:1.0:1736271665.942632:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b35cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024076224:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271665.942633:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b35e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024075968:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271665.942634:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1736271665.942646:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7025 00000100:00100000:2.0:1736271665.942650:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024076288:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271665.942676:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:0.0:1736271665.942677:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b35e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024075968:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271665.942680:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b35cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024076224:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271665.942680:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024076096:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271665.942683:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1736271665.942684:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7024 00000100:00100000:2.0:1736271665.942693:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024076288:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271665.942698:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7025 00000100:00100000:1.0:1736271665.942707:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024076224:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271665.942708:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024076096:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271665.942712:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1736271665.942720:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b16d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024076096:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271665.942723:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024075968:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271665.942727:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271665.942737:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024076288:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271665.942737:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024076032:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271665.942754:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271665.942773:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024076160:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271665.942787:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024075904 00000100:00100000:3.0:1736271665.942787:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271665.942798:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b10e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024076352:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271665.942799:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076032 00000100:00100000:3.0:1736271665.942806:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271665.942808:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:0.0:1736271665.942811:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb917c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024075904:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271665.942812:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076352 00000100:00100000:2.0:1736271665.942819:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076160 00010000:02000000:0.0:1736271665.942821:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271665.942823:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:1.0:1736271665.942827:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb90980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024076032:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271665.942827:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:3.0:1736271665.942829:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024076352:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271665.942832:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736271665.942835:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271665.942836:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112789 00000100:00100000:2.0:1736271665.942839:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024076160:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271665.942845:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271665.942849:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb917c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024075904:12345-0@lo:38:kworker/u8:2.0 Request processed in 36us (121us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271665.942849:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb90980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024076032:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (95us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271665.942850:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024076352:12345-0@lo:38:kworker/u8:2.0 Request processed in 20us (43us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271665.942853:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:0.0:1736271665.942855:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:1.0:1736271665.942857:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1736271665.942865:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024076160:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (77us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271665.942869:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112789 00000100:00080000:3.0:1736271665.942869:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271665.942870:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271665.942872:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024076160:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271665.942877:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271665.942878:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271665.942883:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b10e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024076352:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271665.942889:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271665.942891:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271665.942892:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b117c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024075904:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271665.942896:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271665.942897:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271665.942898:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024076032:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271666.508436:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271667.510425:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271668.512466:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271669.514495:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271669.638461:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736271669.638468:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736271669.638482:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024076480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271669.638482:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024076416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271669.638534:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271669.638572:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271669.638590:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076480 00000100:00100000:1.0:1736271669.638604:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076416 00000100:00100000:0.0:1736271669.638626:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5824 00000100:00100000:0.0:1736271669.638644:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024076480:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271669.638654:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5825 00000100:00100000:3.0:1736271669.638659:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5717c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024076416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271669.638676:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:3.0:1736271669.638676:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271669.638712:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5717c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024076416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271669.638719:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5825 00000100:00100000:0.0:1736271669.638720:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024076480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271669.638726:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5824 00000100:00100000:2.0:1736271669.638740:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024076416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271669.638765:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b572140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024076480:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271670.516480:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271670.716570:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271670.716638:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271670.716686:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971200 00000100:00100000:0.0:1736271670.716693:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271670.716726:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971328 00000100:00100000:2.0:1736271670.716744:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 230 00000100:00100000:0.0:1736271670.716745:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971264 00000100:00100000:2.0:1736271670.716749:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058971200:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271670.716760:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 726 00000100:00100000:0.0:1736271670.716765:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 970 00000100:00100000:1.0:1736271670.716765:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b14280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058971328:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271670.716769:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b11c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058971264:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271670.716782:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271670.716811:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058971200:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 62us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271670.716812:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b14280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058971328:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 47us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271670.716818:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 230 00000100:00100000:0.0:1736271670.716819:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b11c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058971264:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 50us (128us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271670.716824:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 726 00000100:00100000:0.0:1736271670.716828:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 970 00000100:00080000:0.0:1736271670.950456:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271670.950463:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271670.950467:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271670.950474:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8451 00000100:00080000:0.0:1736271670.950478:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271670.950484:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271670.950486:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024076544:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271670.950504:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b13440 x1820604024076608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271670.950549:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271670.950553:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271670.950554:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271670.950556:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8451 00000100:00100000:2.0:1736271670.950556:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271670.950558:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271670.950561:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271670.950561:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024076608:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271670.950570:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b12140 x1820604024076736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271670.950577:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1736271670.950584:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271670.950587:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271670.950591:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024076800:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271670.950598:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271670.950602:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271670.950605:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8451 00000100:00080000:0.0:1736271670.950606:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271670.950609:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271670.950640:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271670.950641:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b12600 x1820604024076864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271670.950642:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024076736:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271670.950656:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076544 00000100:00100000:1.0:1736271670.950657:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024076672:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271670.950662:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271670.950667:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271670.950670:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271670.950671:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271670.950674:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8451 00000100:00080000:0.0:1736271670.950675:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:3.0:1736271670.950675:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024076864:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271670.950678:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271670.950680:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271670.950686:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b150c0 x1820604024077056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271670.950693:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1736271670.950695:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271670.950697:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024076544:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271670.950704:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b117c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024076928:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271670.950707:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024077056:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271670.950712:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076608 00000100:00100000:0.0:1736271670.950729:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076800 00000100:00100000:1.0:1736271670.950730:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271670.950735:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024076544:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271670.950737:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271670.950742:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271670.950742:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1736271670.950745:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076736 00000100:00100000:1.0:1736271670.950746:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b10e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024076992:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271670.950751:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076672 00000100:00100000:3.0:1736271670.950759:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077056 00000100:00100000:0.0:1736271670.950762:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1736271670.950763:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271670.950766:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9ec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024076800:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271670.950770:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1736271670.950772:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024076672:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271670.950776:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076864 00000100:00100000:1.0:1736271670.950786:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076928 00000100:00100000:2.0:1736271670.950793:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112790 00000100:00100000:2.0:1736271670.950797:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b577200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024076864:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271670.950797:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024076672:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271670.950802:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:0.0:1736271670.950808:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9ec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024076800:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271670.950809:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024076992 00010000:02000000:2.0:1736271670.950810:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271670.950813:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1736271670.950815:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:3.0:1736271670.950818:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b574280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024076608:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271670.950823:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:1.0:1736271670.950824:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7026 00010000:02000000:3.0:1736271670.950824:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271670.950825:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024076736:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271670.950827:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a2f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024076928:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:0.0:1736271670.950830:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271670.950835:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b577200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024076864:12345-0@lo:38:kworker/u8:2.0 Request processed in 38us (140us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271670.950839:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112790 00000100:00100000:3.0:1736271670.950842:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b574280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024076608:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (244us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271670.950847:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:0.0:1736271670.950853:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024076736:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (191us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271670.950854:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1736271670.950856:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024077056:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271670.950857:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:1.0:1736271670.950859:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a2f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024076928:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271670.950861:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024076544:0@lo:400:kworker/u8:2.0 00010000:02000000:3.0:1736271670.950861:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271670.950864:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7026 00000100:00100000:3.0:1736271670.950874:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024077056:12345-0@lo:38:kworker/u8:2.0 Request processed in 17us (138us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271670.950875:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7027 00000100:00100000:0.0:1736271670.950879:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a1c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024076992:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271670.950879:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00080000:2.0:1736271670.950887:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271670.950890:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271670.950896:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b117c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024076928:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271670.950899:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024077056:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271670.950901:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a1c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024076992:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271670.950906:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7027 00000100:00080000:2.0:1736271670.950909:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271670.950911:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b10e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024076992:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271670.950911:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271670.950913:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024076864:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271670.950920:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271670.950922:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271670.950924:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024076736:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271670.950929:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024076800:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271670.950931:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271670.950932:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271670.950935:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024076608:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271670.950938:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024076672:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271671.518433:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271672.520468:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271673.522446:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271674.524462:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271674.646472:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024077184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271674.646489:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024077120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271674.646528:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271674.646556:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271674.646612:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077184 00000100:00100000:0.0:1736271674.646644:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077120 00000100:00100000:2.0:1736271674.646658:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5826 00000100:00100000:2.0:1736271674.646664:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024077184:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271674.646667:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5827 00000100:00100000:0.0:1736271674.646672:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024077120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271674.646694:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:0.0:1736271674.646698:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271674.646732:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024077184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271674.646737:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5826 00000100:00100000:0.0:1736271674.646750:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024077120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271674.646750:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024077184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271674.646756:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5827 00000100:00100000:3.0:1736271674.646786:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024077120:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271675.526455:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271675.724455:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271675.724492:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271675.724518:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271675.724523:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971392 00000100:00100000:1.0:1736271675.724549:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971520 00000100:00100000:2.0:1736271675.724557:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 232 00000100:00100000:2.0:1736271675.724561:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058971392:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271675.724575:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971456 00000100:00100000:2.0:1736271675.724626:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058971392:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271675.724628:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 729 00000100:00100000:2.0:1736271675.724631:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 232 00000100:00100000:1.0:1736271675.724632:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b12ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058971520:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271675.724648:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 974 00000100:00100000:3.0:1736271675.724656:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b16d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058971456:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:1.0:1736271675.724659:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b12ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058971520:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 26us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271675.724664:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 729 00010000:02000000:3.0:1736271675.724689:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271675.724756:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b16d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058971456:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 101us (237us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271675.724763:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 974 00000100:00080000:0.0:1736271675.958432:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271675.958438:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271675.958440:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271675.958446:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8456 00000100:00080000:0.0:1736271675.958449:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271675.958454:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271675.958472:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b104c0 x1820604024077312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271675.958474:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736271675.958491:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024077248:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271675.958519:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271675.958522:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271675.958523:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271675.958524:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1736271675.958526:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8456 00000100:00080000:0.0:1736271675.958529:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271675.958532:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271675.958534:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024077376:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271675.958542:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b12f80 x1820604024077440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271675.958560:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271675.958562:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271675.958564:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271675.958564:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024077312:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271675.958566:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8456 00000100:00080000:0.0:1736271675.958567:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1736271675.958567:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271675.958570:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271675.958575:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271675.958579:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b12140 x1820604024077568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271675.958619:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271675.958622:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271675.958623:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271675.958624:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024077696:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271675.958626:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8456 00000100:00100000:2.0:1736271675.958627:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077248 00000100:00080000:0.0:1736271675.958628:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271675.958631:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271675.958640:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b14c00 x1820604024077760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271675.958644:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271675.958649:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271675.958657:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1736271675.958662:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024077248:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271675.958670:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077376 00000100:00100000:3.0:1736271675.958670:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024077440:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271675.958671:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024077632:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271675.958684:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271675.958693:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271675.958698:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024077248:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271675.958703:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077312 00000100:00100000:2.0:1736271675.958704:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1736271675.958705:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024077568:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271675.958706:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736271675.958711:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024077504:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271675.958713:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077440 00000100:00100000:3.0:1736271675.958721:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271675.958724:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:0.0:1736271675.958727:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024077376:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271675.958729:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271675.958730:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024077760:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271675.958736:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077504 00000100:00100000:3.0:1736271675.958742:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271675.958748:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077696 00000100:00100000:2.0:1736271675.958751:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077760 00000100:00100000:2.0:1736271675.958759:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1736271675.958763:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024077504:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271675.958768:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024077376:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271675.958769:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077632 00000100:00100000:3.0:1736271675.958769:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077568 00000100:00100000:0.0:1736271675.958773:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1736271675.958781:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7028 00000100:00100000:0.0:1736271675.958784:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:1.0:1736271675.958785:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024077696:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271675.958788:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1263c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024077312:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271675.958788:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112791 00000100:00100000:3.0:1736271675.958792:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f124740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024077568:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271675.958793:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024077504:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (63us total) trans 0 rc 0/0 00010000:02000000:0.0:1736271675.958797:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271675.958799:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00010000:02000000:3.0:1736271675.958802:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271675.958810:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:2.0:1736271675.958813:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1250c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024077440:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271675.958820:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271675.958827:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1263c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024077312:12345-0@lo:38:kworker/u8:2.0 Request processed in 39us (183us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271675.958828:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f124740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024077568:12345-0@lo:38:kworker/u8:2.0 Request processed in 35us (106us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271675.958832:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112791 00000100:00100000:0.0:1736271675.958833:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:1.0:1736271675.958835:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024077696:12345-0@lo:400:kworker/u8:2.0 Request processed in 50us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271675.958841:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7028 00000100:00100000:2.0:1736271675.958841:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1250c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024077440:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (156us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271675.958842:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1736271675.958845:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f120980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024077760:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271675.958847:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00010000:02000000:0.0:1736271675.958850:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271675.958853:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7029 00000100:00080000:3.0:1736271675.958855:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271675.958856:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024077632:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271675.958857:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271675.958860:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024077568:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271675.958868:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271675.958869:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271675.958872:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f120980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024077760:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (129us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271675.958877:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:2.0:1736271675.958879:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024077504:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271675.958881:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024077632:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271675.958881:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024077760:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271675.958886:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7029 00000100:00100000:2.0:1736271675.958889:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024077632:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271675.958893:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271675.958895:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271675.958897:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024077312:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271675.958905:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271675.958907:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271675.958909:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024077440:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271675.958912:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024077248:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271675.958923:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024077696:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271675.958934:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024077376:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271676.528465:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271677.530435:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271678.532453:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271679.534466:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271679.654459:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024077824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271679.654525:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271679.654536:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024077888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271679.654555:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077824 00000100:00100000:1.0:1736271679.654589:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271679.654607:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077888 00000100:00100000:0.0:1736271679.654622:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5828 00000100:00100000:0.0:1736271679.654625:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024077824:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271679.654640:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5829 00000100:00100000:2.0:1736271679.654643:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024077888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271679.654645:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271679.654656:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271679.654682:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024077824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271679.654688:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5828 00000100:00100000:2.0:1736271679.654694:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024077888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271679.654700:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5829 00000100:00100000:1.0:1736271679.654706:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024077888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271679.654714:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024077824:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271680.536416:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271680.732535:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271680.732608:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271680.732612:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971584 00000100:00100000:0.0:1736271680.732650:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271680.732650:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 234 00000100:00100000:2.0:1736271680.732654:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058971584:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271680.732669:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971648 00000100:00100000:0.0:1736271680.732671:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971712 00000100:00100000:1.0:1736271680.732691:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 732 00000100:00100000:1.0:1736271680.732696:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058971712:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271680.732700:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 978 00000100:00100000:0.0:1736271680.732703:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b10e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058971648:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:2.0:1736271680.732705:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058971584:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 50us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271680.732711:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 234 00010000:02000000:0.0:1736271680.732713:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271680.732727:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058971712:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 31us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271680.732734:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 732 00000100:00100000:0.0:1736271680.732738:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b10e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058971648:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 34us (131us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271680.732744:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 978 00000100:00080000:0.0:1736271680.966433:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271680.966438:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271680.966440:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271680.966444:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8461 00000100:00080000:0.0:1736271680.966447:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271680.966451:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271680.966465:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b150c0 x1820604024078016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271680.966470:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024077952:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271680.966492:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271680.966494:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271680.966495:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271680.966497:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8461 00000100:00100000:1.0:1736271680.966497:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024078080:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271680.966498:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271680.966500:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271680.966506:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b16880 x1820604024078144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271680.966524:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024078016:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271680.966533:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271680.966535:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271680.966535:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271680.966538:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271680.966539:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271680.966542:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8461 00000100:00080000:0.0:1736271680.966543:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271680.966545:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271680.966570:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b104c0 x1820604024078272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271680.966584:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024078208:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271680.966588:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271680.966595:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271680.966597:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024078336:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271680.966598:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271680.966599:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271680.966601:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8461 00000100:00080000:0.0:1736271680.966602:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1736271680.966604:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271680.966605:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271680.966607:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024078144:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271680.966613:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b14740 x1820604024078464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271680.966621:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271680.966624:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271680.966629:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024078272:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271680.966629:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078080 00000100:00100000:0.0:1736271680.966634:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078016 00000100:00100000:1.0:1736271680.966638:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736271680.966640:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271680.966642:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024078400:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271680.966647:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024078464:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271680.966650:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078208 00000100:00100000:3.0:1736271680.966656:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078144 00000100:00100000:2.0:1736271680.966658:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271680.966659:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:1.0:1736271680.966659:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271680.966662:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024078080:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271680.966664:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:3.0:1736271680.966666:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f125f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024078208:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271680.966680:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024077952 00000100:00100000:1.0:1736271680.966681:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078336 00000100:00100000:3.0:1736271680.966689:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f125f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024078208:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271680.966693:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1736271680.966697:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1736271680.966699:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024078080:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271680.966699:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024077952:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271680.966701:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078400 00000100:00100000:3.0:1736271680.966701:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078464 00000100:00100000:0.0:1736271680.966705:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:1.0:1736271680.966713:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7030 00000100:00100000:3.0:1736271680.966715:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:1.0:1736271680.966716:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a3900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024078336:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271680.966716:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024077952:12345-0@lo:400:kworker/u8:2.0 Request processed in 16us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271680.966719:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1736271680.966719:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024078016:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271680.966720:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:0.0:1736271680.966722:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024078144:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271680.966729:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736271680.966734:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271680.966735:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:2.0:1736271680.966737:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024078464:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271680.966742:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271680.966745:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a3900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024078336:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271680.966751:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7030 00000100:00100000:1.0:1736271680.966761:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7031 00000100:00100000:1.0:1736271680.966764:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024078400:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271680.966765:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024078464:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (107us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271680.966766:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024078144:12345-0@lo:38:kworker/u8:2.0 Request processed in 42us (143us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271680.966768:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:3.0:1736271680.966768:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024078016:12345-0@lo:38:kworker/u8:2.0 Request processed in 48us (180us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271680.966772:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:3.0:1736271680.966775:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1736271680.966782:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078272 00000100:00100000:1.0:1736271680.966783:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024078400:12345-0@lo:400:kworker/u8:2.0 Request processed in 18us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271680.966787:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7031 00000100:00100000:2.0:1736271680.966792:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112792 00000100:00100000:2.0:1736271680.966794:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c17c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024078272:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271680.966797:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271680.966805:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024078080:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271680.966808:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c17c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024078272:12345-0@lo:38:kworker/u8:2.0 Request processed in 14us (168us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271680.966809:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024077952:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271680.966811:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112792 00000100:00100000:1.0:1736271680.966815:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024078400:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271680.966823:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024078336:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271680.966824:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271680.966826:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271680.966826:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024078208:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271680.966828:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024078464:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271680.966832:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271680.966833:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271680.966834:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024078144:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271680.966838:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271680.966842:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271680.966844:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024078272:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271680.966849:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271680.966850:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271680.966851:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024078016:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271681.538441:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271682.540477:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271683.542451:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271684.544455:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271684.662445:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024078528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271684.662455:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024078592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271684.662507:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271684.662584:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078528 00000100:00100000:0.0:1736271684.662613:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5830 00000100:00100000:2.0:1736271684.662614:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271684.662617:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f123440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024078528:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271684.662624:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078592 00002000:00000024:0.0:1736271684.662637:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271684.662648:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5831 00000100:00100000:3.0:1736271684.662651:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024078592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1736271684.662663:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271684.662666:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f123440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024078528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271684.662670:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5830 00000100:00100000:3.0:1736271684.662684:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024078592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (72us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271684.662688:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5831 00000100:00100000:2.0:1736271684.662706:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024078592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271684.662708:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024078528:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271685.546440:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271685.740485:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271685.740545:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271685.740573:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971776 00000100:00100000:0.0:1736271685.740583:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271685.740607:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971904 00000100:00100000:2.0:1736271685.740612:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 236 00000100:00100000:0.0:1736271685.740613:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971840 00000100:00100000:2.0:1736271685.740618:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058971776:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271685.740645:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 735 00000100:00100000:0.0:1736271685.740650:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b12600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058971904:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271685.740659:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 982 00000100:00100000:3.0:1736271685.740664:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b13440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058971840:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:2.0:1736271685.740669:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058971776:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 51us (190us total) trans 0 rc 0/0 00010000:02000000:3.0:1736271685.740674:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271685.740676:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 236 00000100:00100000:0.0:1736271685.740679:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b12600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058971904:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 29us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271685.740685:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 735 00000100:00100000:3.0:1736271685.740694:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b13440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058971840:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 30us (112us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271685.740697:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 982 00000100:00080000:0.0:1736271685.974431:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271685.974437:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271685.974440:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271685.974445:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8466 00000100:00080000:0.0:1736271685.974459:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271685.974468:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271685.974479:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271685.974487:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b150c0 x1820604024078720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271685.974501:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024078656:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271685.974536:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271685.974539:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271685.974540:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271685.974543:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8466 00000100:00100000:1.0:1736271685.974544:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1736271685.974545:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271685.974548:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271685.974553:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024078784:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271685.974557:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b16880 x1820604024078848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271685.974572:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024078720:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271685.974577:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271685.974579:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271685.974580:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271685.974581:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271685.974584:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8466 00000100:00080000:0.0:1736271685.974585:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271685.974587:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271685.974590:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271685.974595:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b14c00 x1820604024078976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271685.974602:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736271685.974605:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271685.974610:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024079040:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271685.974615:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271685.974617:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271685.974618:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271685.974620:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8466 00000100:00080000:0.0:1736271685.974622:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00100000:2.0:1736271685.974622:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024078848:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271685.974629:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271685.974630:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078784 00000100:00100000:3.0:1736271685.974630:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271685.974637:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b11300 x1820604024079168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271685.974640:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024078912:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271685.974642:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271685.974655:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078720 00000100:00100000:3.0:1736271685.974656:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271685.974658:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079040 00000100:00100000:2.0:1736271685.974658:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024078976:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271685.974673:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078848 00000100:00100000:2.0:1736271685.974676:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271685.974678:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7032 00000100:00100000:3.0:1736271685.974679:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078912 00000100:00100000:1.0:1736271685.974680:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1736271685.974683:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1276c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024079040:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271685.974683:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024078784:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271685.974685:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024079168:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271685.974696:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:3.0:1736271685.974699:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024078912:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271685.974705:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271685.974718:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024078784:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271685.974723:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1276c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024079040:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271685.974724:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1736271685.974727:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7032 00000100:00100000:2.0:1736271685.974728:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078656 00000100:00100000:3.0:1736271685.974735:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024078912:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271685.974737:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079168 00000100:00100000:3.0:1736271685.974740:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1736271685.974745:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:1.0:1736271685.974747:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1736271685.974748:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb14280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024078720:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271685.974748:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1736271685.974749:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c482600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024078848:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271685.974752:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024078656:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271685.974752:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:3.0:1736271685.974755:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c485580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024079168:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271685.974757:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736271685.974762:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736271685.974762:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271685.974778:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024078656:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271685.974782:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1736271685.974784:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb14280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024078720:12345-0@lo:38:kworker/u8:2.0 Request processed in 36us (180us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271685.974784:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c482600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024078848:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (142us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271685.974786:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c485580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024079168:12345-0@lo:38:kworker/u8:2.0 Request processed in 30us (80us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271685.974789:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1736271685.974796:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:3.0:1736271685.974798:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:2.0:1736271685.974807:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024078976 00000100:00100000:1.0:1736271685.974808:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024079104:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271685.974818:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024078656:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271685.974821:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112793 00000100:00100000:2.0:1736271685.974825:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024078976:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271685.974825:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024079040:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271685.974827:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:2.0:1736271685.974831:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271685.974833:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024078912:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271685.974841:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024078784:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271685.974850:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024078976:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (174us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271685.974855:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112793 00000100:00100000:1.0:1736271685.974856:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079104 00000100:00080000:2.0:1736271685.974875:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271685.974877:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271685.974878:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7033 00000100:00100000:2.0:1736271685.974880:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024078976:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271685.974881:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024079104:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271685.974888:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271685.974890:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271685.974892:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024079168:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271685.974898:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271685.974900:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271685.974901:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024078720:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271685.974906:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024079104:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (79us total) trans 0 rc 0/0 00000100:00080000:2.0:1736271685.974908:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271685.974911:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7033 00000100:00080000:2.0:1736271685.974914:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271685.974916:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024079104:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271685.974917:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024078848:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271686.548452:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271687.550575:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271688.552474:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271689.554443:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271689.670410:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024079232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271689.670420:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4804c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024079296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271689.670464:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271689.670484:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079296 00000100:00100000:1.0:1736271689.670515:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271689.670538:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079232 00000100:00100000:0.0:1736271689.670556:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5832 00000100:00100000:1.0:1736271689.670560:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5833 00000100:00100000:0.0:1736271689.670561:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f126d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024079296:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271689.670564:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024079232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271689.670584:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:1.0:1736271689.670584:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:1.0:1736271689.670610:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024079232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271689.670616:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5833 00000100:00100000:0.0:1736271689.670618:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f126d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024079296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271689.670633:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5832 00000100:00100000:2.0:1736271689.670634:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024079232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271689.670634:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c4804c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024079296:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271690.556444:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271690.748477:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271690.748560:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271690.748623:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972096 00000100:00100000:0.0:1736271690.748640:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271690.748673:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972032 00000100:00100000:1.0:1736271690.748692:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 738 00000100:00100000:0.0:1736271690.748697:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 986 00000100:00100000:1.0:1736271690.748697:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058972096:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271690.748702:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b12f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058972032:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:2.0:1736271690.748708:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058971968 00010000:02000000:0.0:1736271690.748714:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271690.748734:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 238 00000100:00100000:2.0:1736271690.748738:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058971968:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271690.748749:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b12f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058972032:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 47us (110us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271690.748751:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058972096:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 53us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271690.748755:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 986 00000100:00100000:1.0:1736271690.748759:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 738 00000100:00100000:2.0:1736271690.748763:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058971968:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 25us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271690.748768:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 238 00000100:00080000:0.0:1736271690.982398:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271690.982405:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271690.982407:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271690.982413:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8471 00000100:00080000:0.0:1736271690.982417:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271690.982421:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271690.982429:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271690.982439:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b150c0 x1820604024079424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271690.982446:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024079360:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271690.982478:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271690.982481:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271690.982482:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271690.982503:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8471 00000100:00080000:0.0:1736271690.982505:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00100000:1.0:1736271690.982507:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024079488:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271690.982508:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271690.982513:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024079424:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271690.982515:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b14c00 x1820604024079552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271690.982518:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271690.982535:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271690.982537:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271690.982538:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271690.982540:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8471 00000100:00080000:0.0:1736271690.982541:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271690.982543:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271690.982545:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271690.982548:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b14740 x1820604024079680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271690.982550:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024079616:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271690.982558:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079360 00000100:00080000:0.0:1736271690.982563:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271690.982565:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271690.982566:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271690.982567:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8471 00000100:00100000:2.0:1736271690.982567:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271690.982568:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271690.982570:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271690.982574:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf59300 x1820604024079872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271690.982576:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079488 00000100:00100000:3.0:1736271690.982581:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1736271690.982584:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024079360:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271690.982587:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf584c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024079808:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271690.982592:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079616 00000100:00100000:2.0:1736271690.982592:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271690.982600:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079424 00000100:00100000:2.0:1736271690.982605:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024079552:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271690.982607:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:1.0:1736271690.982609:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024079488:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271690.982611:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271690.982611:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024079360:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271690.982615:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1736271690.982617:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271690.982627:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736271690.982629:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024079680:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271690.982630:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024079744:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271690.982637:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024079488:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271690.982641:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:0.0:1736271690.982645:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271690.982645:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271690.982647:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079552 00000100:00100000:3.0:1736271690.982647:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024079360:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271690.982651:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:1.0:1736271690.982653:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c480e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024079616:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271690.982654:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf59300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024079872:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271690.982659:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079808 00000100:00100000:2.0:1736271690.982667:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271690.982670:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c480e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024079616:12345-0@lo:400:kworker/u8:2.0 Request processed in 16us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271690.982673:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079744 00000100:00100000:3.0:1736271690.982675:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079872 00000100:00100000:1.0:1736271690.982678:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:0.0:1736271690.982681:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7034 00000100:00100000:0.0:1736271690.982684:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024079808:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271690.982685:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1736271690.982687:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4817c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024079424:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271690.982688:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:2.0:1736271690.982692:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024079616:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271690.982692:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c482140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024079552:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271690.982696:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736271690.982698:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271690.982710:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1736271690.982712:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024079808:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271690.982716:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7034 00000100:00100000:2.0:1736271690.982720:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c484280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024079872:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271690.982721:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4817c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024079424:12345-0@lo:38:kworker/u8:2.0 Request processed in 33us (129us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271690.982723:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7035 00000100:00100000:3.0:1736271690.982723:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c482140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024079552:12345-0@lo:38:kworker/u8:2.0 Request processed in 31us (105us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271690.982725:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024079744:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271690.982727:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00010000:02000000:2.0:1736271690.982727:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271690.982729:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:0.0:1736271690.982735:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024079744:12345-0@lo:400:kworker/u8:2.0 Request processed in 10us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271690.982738:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7035 00000100:00100000:3.0:1736271690.982743:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079680 00000100:00100000:2.0:1736271690.982746:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c484280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024079872:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (79us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271690.982751:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1736271690.982753:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024079488:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271690.982753:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112794 00000100:00100000:3.0:1736271690.982755:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c483440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024079680:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271690.982759:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271690.982760:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024079744:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271690.982765:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf584c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024079808:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271690.982769:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271690.982771:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271690.982771:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c483440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024079680:12345-0@lo:38:kworker/u8:2.0 Request processed in 16us (127us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271690.982774:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112794 00000100:00100000:2.0:1736271690.982775:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024079552:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271690.982782:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271690.982784:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271690.982786:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024079680:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271690.982791:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271690.982792:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271690.982793:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf59300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024079872:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271690.982797:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271690.982798:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271690.982799:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024079424:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271691.558435:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271692.560450:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271693.562453:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271694.564444:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271694.678427:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf584c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024080000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271694.678452:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4850c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024079936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271694.678504:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271694.678535:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271694.678556:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080000 00000100:00100000:2.0:1736271694.678560:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024079936 00000100:00100000:0.0:1736271694.678600:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5834 00000100:00100000:0.0:1736271694.678605:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c485a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024080000:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271694.678605:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5835 00000100:00100000:2.0:1736271694.678609:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024079936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271694.678625:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271694.678625:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271694.678666:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c485a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024080000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271694.678672:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5834 00000100:00100000:2.0:1736271694.678675:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024079936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271694.678681:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5835 00000100:00100000:3.0:1736271694.678683:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf584c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024080000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271694.678703:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c4850c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024079936:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271695.566450:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271695.756634:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271695.756676:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271695.756723:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972160 00000100:00100000:0.0:1736271695.756727:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271695.756756:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972288 00000100:00100000:2.0:1736271695.756765:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 240 00000100:00100000:2.0:1736271695.756770:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058972160:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271695.756790:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972224 00000100:00100000:3.0:1736271695.756800:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 741 00000100:00100000:3.0:1736271695.756803:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058972288:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271695.756805:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 990 00000100:00100000:1.0:1736271695.756810:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058972224:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:2.0:1736271695.756820:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058972160:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 50us (193us total) trans 0 rc 0/0 00010000:02000000:1.0:1736271695.756821:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271695.756824:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 240 00000100:00100000:3.0:1736271695.756832:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058972288:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 28us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271695.756839:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 741 00000100:00100000:1.0:1736271695.756847:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058972224:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 37us (120us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271695.756852:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 990 00000100:00080000:0.0:1736271695.990422:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271695.990429:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271695.990431:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271695.990437:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8476 00000100:00100000:3.0:1736271695.990447:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024080064:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271695.990467:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271695.990473:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271695.990489:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5c280 x1820604024080128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271695.990518:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271695.990521:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271695.990522:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271695.990525:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8476 00000100:00080000:0.0:1736271695.990527:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271695.990530:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271695.990538:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5bdc0 x1820604024080256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271695.990546:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271695.990553:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024080128:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271695.990557:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271695.990560:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271695.990561:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271695.990563:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8476 00000100:00080000:0.0:1736271695.990565:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271695.990568:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271695.990574:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271695.990577:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5d0c0 x1820604024080384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271695.990578:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024080192:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271695.990586:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271695.990596:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024080448:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271695.990598:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271695.990600:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271695.990601:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271695.990604:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8476 00000100:00080000:0.0:1736271695.990605:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:2.0:1736271695.990606:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024080256:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271695.990611:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271695.990614:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271695.990622:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271695.990625:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5f200 x1820604024080576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271695.990625:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271695.990625:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf58980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024080320:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271695.990629:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736271695.990636:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271695.990639:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024080512:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271695.990640:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024080384:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271695.990653:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080448 00000100:00100000:3.0:1736271695.990653:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080128 00000100:00100000:2.0:1736271695.990662:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271695.990666:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271695.990669:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080256 00000100:00100000:2.0:1736271695.990673:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024080576:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271695.990675:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080320 00000100:00100000:0.0:1736271695.990683:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080512 00000100:00100000:3.0:1736271695.990687:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1736271695.990689:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271695.990690:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f125a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024080320:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271695.990697:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7036 00000100:00100000:0.0:1736271695.990701:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f121300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024080448:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271695.990702:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080576 00000100:00100000:2.0:1736271695.990709:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080064 00000100:00100000:3.0:1736271695.990716:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f125a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024080320:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271695.990719:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:1.0:1736271695.990722:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1736271695.990725:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4863c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024080128:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271695.990728:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1736271695.990728:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:2.0:1736271695.990731:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024080064:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271695.990734:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f121300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024080448:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271695.990734:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c486880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024080256:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271695.990740:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7036 00010000:02000000:1.0:1736271695.990741:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736271695.990741:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271695.990749:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7037 00000100:00100000:0.0:1736271695.990752:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a3440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024080512:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271695.990758:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024080064:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271695.990763:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1736271695.990769:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c486880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024080256:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (144us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271695.990771:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4863c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024080128:12345-0@lo:38:kworker/u8:2.0 Request processed in 44us (185us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271695.990774:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:1.0:1736271695.990778:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1736271695.990779:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a3440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024080512:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271695.990785:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:0.0:1736271695.990786:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7037 00000100:00100000:3.0:1736271695.990788:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c482ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024080576:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271695.990793:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1736271695.990807:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271695.990810:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024080512:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271695.990812:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c482ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024080576:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (122us total) trans 0 rc -19/-19 00000100:00080000:2.0:1736271695.990815:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271695.990817:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:2.0:1736271695.990818:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024080128:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271695.990820:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080384 00000100:00080000:2.0:1736271695.990827:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271695.990829:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271695.990831:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024080256:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271695.990834:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112795 00000100:00100000:3.0:1736271695.990836:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf58980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024080320:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271695.990837:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c486d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024080384:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271695.990841:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271695.990842:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00010000:02000000:0.0:1736271695.990843:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271695.990843:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024080576:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271695.990845:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024080448:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271695.990865:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c486d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024080384:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (203us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271695.990867:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271695.990869:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271695.990870:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112795 00000100:00080000:2.0:1736271695.990870:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271695.990872:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024080384:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271695.990880:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024080064:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271695.990884:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080192 00000100:00100000:0.0:1736271695.990907:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:0.0:1736271695.990910:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f120e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024080192:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271695.990941:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f120e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024080192:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271695.990951:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:3.0:1736271695.990952:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024080192:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271696.568442:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271697.570493:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271698.572497:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271699.574475:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271699.686510:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736271699.686513:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024080704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271699.686521:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c482f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024080640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271699.686571:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271699.686599:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271699.686612:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080704 00000100:00100000:0.0:1736271699.686656:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080640 00000100:00100000:0.0:1736271699.686673:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5836 00000100:00100000:0.0:1736271699.686677:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a17c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024080704:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271699.686687:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5837 00000100:00100000:2.0:1736271699.686693:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f125580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024080640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271699.686701:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271699.686708:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271699.686737:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f125580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024080640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271699.686742:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5837 00000100:00100000:0.0:1736271699.686745:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a17c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024080704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271699.686750:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5836 00000100:00100000:3.0:1736271699.686761:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c482f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024080640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271699.686773:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024080704:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271700.576538:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271700.764396:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271700.764453:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271700.764502:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972352 00000100:00100000:1.0:1736271700.764538:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972480 00000100:00100000:0.0:1736271700.764544:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271700.764568:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 242 00000100:00100000:1.0:1736271700.764573:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972416 00000100:00100000:3.0:1736271700.764574:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058972352:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271700.764586:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 744 00000100:00100000:1.0:1736271700.764590:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf59c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058972480:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271700.764599:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 994 00000100:00100000:0.0:1736271700.764606:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058972416:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271700.764623:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271700.764644:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf59c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058972480:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 52us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271700.764649:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 744 00000100:00100000:3.0:1736271700.764651:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058972352:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 76us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271700.764658:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 242 00000100:00100000:0.0:1736271700.764665:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058972416:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 59us (121us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271700.764671:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 994 00000100:00080000:0.0:1736271700.998396:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271700.998401:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271700.998404:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271700.998411:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8481 00000100:00080000:0.0:1736271700.998415:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271700.998433:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271700.998448:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5b440 x1820604024080832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271700.998449:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf597c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024080768:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271700.998494:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271700.998496:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271700.998497:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271700.998500:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8481 00000100:00080000:0.0:1736271700.998501:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271700.998504:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271700.998506:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271700.998509:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5e880 x1820604024080960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271700.998512:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1736271700.998517:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271700.998519:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271700.998520:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271700.998522:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8481 00000100:00080000:0.0:1736271700.998523:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271700.998525:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271700.998527:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf58e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024081024:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271700.998528:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024080832:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271700.998531:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5f6c0 x1820604024081088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271700.998546:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271700.998547:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080768 00000100:00080000:0.0:1736271700.998548:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271700.998549:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271700.998550:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8481 00000100:00080000:0.0:1736271700.998551:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271700.998553:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271700.998557:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5d0c0 x1820604024081280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271700.998559:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271700.998576:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1736271700.998577:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081024 00000100:00100000:1.0:1736271700.998579:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024080896:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271700.998580:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024080768:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271700.998586:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271700.998596:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024081152:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271700.998603:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080832 00000100:00100000:2.0:1736271700.998607:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024080960:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271700.998612:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1736271700.998614:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024081024:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271700.998616:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024080768:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271700.998620:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271700.998621:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1736271700.998622:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271700.998633:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736271700.998642:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024081088:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271700.998645:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024081216:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271700.998646:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024081024:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271700.998649:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1736271700.998656:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080960 00000100:00100000:3.0:1736271700.998660:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf597c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024080768:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271700.998661:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271700.998664:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:0.0:1736271700.998666:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c487200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024080832:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271700.998666:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271700.998669:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024081280:0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271700.998677:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271700.998680:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271700.998688:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081152 00000100:00100000:3.0:1736271700.998690:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081280 00000100:00100000:2.0:1736271700.998693:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:0.0:1736271700.998695:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c487200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024080832:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (109us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271700.998695:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4876c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024080960:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271700.998698:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00010000:02000000:2.0:1736271700.998701:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271700.998702:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:3.0:1736271700.998706:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c484c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024081280:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271700.998710:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081216 00010000:02000000:3.0:1736271700.998712:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271700.998714:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4876c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024080960:12345-0@lo:38:kworker/u8:2.0 Request processed in 19us (92us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271700.998717:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081088 00000100:00100000:2.0:1736271700.998718:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:1.0:1736271700.998723:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7038 00000100:00100000:0.0:1736271700.998726:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112796 00000100:00100000:1.0:1736271700.998727:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024081152:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271700.998728:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c480980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024081088:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271700.998732:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1736271700.998733:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736271700.998734:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c484c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024081280:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (53us total) trans 0 rc -19/-19 00000100:00080000:2.0:1736271700.998735:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271700.998737:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024080832:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271700.998739:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:0.0:1736271700.998742:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c480980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024081088:12345-0@lo:38:kworker/u8:2.0 Request processed in 14us (81us total) trans 0 rc -19/-19 00000100:00080000:2.0:1736271700.998742:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271700.998743:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271700.998744:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024080960:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271700.998746:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112796 00000100:00080000:2.0:1736271700.998754:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271700.998756:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7039 00000100:00080000:2.0:1736271700.998756:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271700.998757:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024081152:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271700.998757:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024081088:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271700.998758:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024081216:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271700.998761:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271700.998762:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271700.998763:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7038 00000100:00100000:2.0:1736271700.998763:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024081280:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271700.998770:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024081216:12345-0@lo:400:kworker/u8:2.0 Request processed in 12us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271700.998774:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7039 00000100:00100000:1.0:1736271700.998785:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271700.998803:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024080896 00000100:00100000:1.0:1736271700.998806:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf58e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024081024:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271700.998825:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024081216:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271700.998828:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:3.0:1736271700.998830:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024080896:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271700.998832:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024081152:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271700.998852:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024080896:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (68us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271700.998863:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1736271700.998866:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024080896:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271701.578469:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271702.580475:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271703.582571:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271704.584612:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271704.694476:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024081408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271704.694533:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271704.694565:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c483900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024081344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271704.694580:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271704.694606:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081408 00000100:00100000:2.0:1736271704.694620:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081344 00000100:00100000:0.0:1736271704.694638:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5838 00000100:00100000:0.0:1736271704.694648:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f122140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024081408:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271704.694649:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5839 00000100:00100000:3.0:1736271704.694653:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f122f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024081344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271704.694670:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:3.0:1736271704.694670:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271704.694699:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f122f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024081344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271704.694705:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f122140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024081408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271704.694705:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5839 00000100:00100000:0.0:1736271704.694710:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5838 00000100:00100000:2.0:1736271704.694718:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024081408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271704.694725:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c483900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024081344:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271705.586488:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271705.772489:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271705.772544:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271705.772585:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271705.772598:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972544 00000100:00100000:1.0:1736271705.772607:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972672 00000100:00100000:1.0:1736271705.772629:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972608 00000100:00100000:3.0:1736271705.772631:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 244 00000100:00100000:3.0:1736271705.772636:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058972544:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271705.772640:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 747 00000100:00100000:1.0:1736271705.772643:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf58980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058972672:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271705.772647:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 998 00000100:00100000:0.0:1736271705.772651:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058972608:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271705.772663:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271705.772688:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf58980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058972672:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 44us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271705.772692:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 747 00000100:00100000:3.0:1736271705.772693:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058972544:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 57us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271705.772695:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058972608:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 43us (111us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271705.772700:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 244 00000100:00100000:0.0:1736271705.772702:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 998 00000100:00080000:0.0:1736271706.006701:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271706.006708:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271706.006711:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271706.006716:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8486 00000100:00080000:0.0:1736271706.006721:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271706.006726:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271706.006744:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5c280 x1820604024081536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271706.006784:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271706.006787:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271706.006788:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271706.006802:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8486 00000100:00080000:0.0:1736271706.006804:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271706.006808:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271706.006817:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf584c0 x1820604024081664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271706.006830:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271706.006832:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271706.006833:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271706.006836:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8486 00000100:00080000:0.0:1736271706.006838:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271706.006840:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271706.006844:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024081536:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271706.006848:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5c740 x1820604024081792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271706.006865:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271706.006867:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271706.006868:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271706.006870:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8486 00000100:00080000:0.0:1736271706.006872:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271706.006874:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271706.006879:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5d580 x1820604024081984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271706.006903:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271706.006906:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024081472:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271706.006949:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271706.006993:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf584c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024081664:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271706.007011:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271706.007012:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024081600:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271706.007028:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024081792:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271706.007045:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271706.007058:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271706.007062:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736271706.007073:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf59300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024081728:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271706.007097:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271706.007175:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024081856:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271706.007205:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271706.007237:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081664 00000100:00100000:0.0:1736271706.007257:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024081920:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271706.007257:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081600 00000100:00100000:3.0:1736271706.007257:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024081984:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271706.007290:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271706.007296:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081728 00000100:00100000:3.0:1736271706.007304:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271706.007305:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1736271706.007309:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024081600:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271706.007328:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081984 00000100:00100000:3.0:1736271706.007330:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1736271706.007334:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024081728:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271706.007340:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:0.0:1736271706.007343:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f122600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024081664:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271706.007350:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024081600:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (306us total) trans 0 rc 0/0 00010000:02000000:0.0:1736271706.007353:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271706.007355:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1736271706.007366:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1736271706.007368:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f124280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024081984:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271706.007373:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271706.007375:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024081728:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271706.007379:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f122600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024081664:12345-0@lo:38:kworker/u8:2.0 Request processed in 35us (367us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271706.007381:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1736271706.007384:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:2.0:1736271706.007384:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f124280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024081984:12345-0@lo:38:kworker/u8:2.0 Request processed in 16us (81us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271706.007403:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:0.0:1736271706.007416:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081792 00000100:00080000:3.0:1736271706.007422:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271706.007429:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271706.007430:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112797 00000100:00100000:3.0:1736271706.007432:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024081984:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271706.007433:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f126880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024081792:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271706.007435:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081856 00010000:02000000:0.0:1736271706.007438:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736271706.007440:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271706.007442:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271706.007444:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf584c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024081664:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271706.007451:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081920 00000100:00100000:0.0:1736271706.007458:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f126880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024081792:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (399us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271706.007462:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112797 00000100:00100000:2.0:1736271706.007462:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7040 00000100:00080000:3.0:1736271706.007462:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271706.007464:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271706.007465:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c483900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024081856:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271706.007466:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024081792:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271706.007479:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081472 00000100:00100000:3.0:1736271706.007481:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7041 00000100:00100000:3.0:1736271706.007484:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf58e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024081920:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271706.007489:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c483900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024081856:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271706.007494:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1736271706.007494:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7040 00000100:00100000:0.0:1736271706.007497:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024081472:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271706.007512:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf58e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024081920:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271706.007517:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7041 00000100:00100000:0.0:1736271706.007520:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024081472:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271706.007523:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024081856:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271706.007524:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1736271706.007550:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024081472:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271706.007558:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024081920:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271706.007585:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024081536 00000100:00100000:1.0:1736271706.007604:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1736271706.007607:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f123dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024081536:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271706.007612:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271706.007647:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f123dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024081536:12345-0@lo:38:kworker/u8:2.0 Request processed in 39us (745us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271706.007653:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00080000:3.0:1736271706.007677:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271706.007684:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf59300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024081728:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271706.007685:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271706.007689:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024081536:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271706.007697:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024081600:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271706.588549:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271707.590501:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271708.592495:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271709.594506:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271709.702508:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c484740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024082048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271709.702508:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024082112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271709.702568:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271709.702608:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271709.702645:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082112 00000100:00100000:2.0:1736271709.702661:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082048 00000100:00100000:0.0:1736271709.702690:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5840 00000100:00100000:0.0:1736271709.702695:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f121c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024082112:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271709.702695:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5841 00000100:00100000:2.0:1736271709.702699:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024082048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271709.702719:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271709.702719:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271709.702761:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f121c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024082112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271709.702766:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5840 00000100:00100000:2.0:1736271709.702769:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024082048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271709.702775:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5841 00000100:00100000:3.0:1736271709.702777:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024082112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271709.702796:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c484740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024082048:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271710.596522:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271710.780498:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271710.780541:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271710.780580:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271710.780593:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972736 00000100:00100000:3.0:1736271710.780612:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972864 00000100:00100000:3.0:1736271710.780646:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972800 00000100:00100000:1.0:1736271710.780655:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 750 00000100:00100000:1.0:1736271710.780662:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058972864:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271710.780662:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1002 00000100:00100000:2.0:1736271710.780665:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 246 00000100:00100000:3.0:1736271710.780666:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058972800:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:2.0:1736271710.780671:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058972736:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00010000:02000000:3.0:1736271710.780677:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271710.780718:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058972864:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 57us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271710.780722:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058972800:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 54us (141us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271710.780723:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 750 00000100:00100000:3.0:1736271710.780728:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1002 00000100:00100000:2.0:1736271710.780734:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058972736:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 63us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271710.780740:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 246 00000100:00080000:0.0:1736271711.014440:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271711.014446:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271711.014449:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271711.014455:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8491 00000100:00080000:0.0:1736271711.014458:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271711.014463:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271711.014480:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5e880 x1820604024082240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271711.014480:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024082176:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271711.014514:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271711.014517:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271711.014518:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271711.014521:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8491 00000100:00080000:0.0:1736271711.014522:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271711.014525:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271711.014532:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024082304:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271711.014534:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf597c0 x1820604024082368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271711.014539:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024082240:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271711.014548:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271711.014559:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271711.014562:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271711.014563:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271711.014566:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8491 00000100:00080000:0.0:1736271711.014576:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1736271711.014577:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271711.014580:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271711.014590:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf58000 x1820604024082496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271711.014601:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf597c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024082368:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271711.014604:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271711.014605:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082176 00000100:00080000:0.0:1736271711.014611:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271711.014614:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271711.014615:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271711.014618:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8491 00000100:00080000:0.0:1736271711.014620:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271711.014622:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271711.014629:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5af80 x1820604024082688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271711.014635:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082240 00000100:00100000:2.0:1736271711.014641:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1736271711.014646:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024082176:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271711.014650:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082304 00000100:00100000:1.0:1736271711.014651:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271711.014656:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1736271711.014656:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024082624:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271711.014660:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f124c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024082240:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271711.014664:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1736271711.014667:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024082304:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:0.0:1736271711.014673:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271711.014678:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271711.014683:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024082176:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271711.014689:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1736271711.014695:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024082304:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271711.014699:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:1.0:1736271711.014707:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024082304:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271711.014709:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f124c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024082240:12345-0@lo:38:kworker/u8:2.0 Request processed in 49us (131us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271711.014714:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:3.0:1736271711.014721:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082624 00000100:00100000:1.0:1736271711.014735:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024082432:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271711.014736:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7042 00000100:00100000:2.0:1736271711.014737:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024082176:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271711.014738:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024082624:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271711.014753:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf59300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024082560:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271711.014760:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271711.014763:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024082624:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271711.014766:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7042 00000100:00100000:0.0:1736271711.014774:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271711.014776:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271711.014795:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024082624:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271711.014795:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082432 00000100:00100000:3.0:1736271711.014795:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024082496:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271711.014809:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082368 00000100:00100000:0.0:1736271711.014813:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1736271711.014816:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024082432:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271711.014817:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271711.014822:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:2.0:1736271711.014825:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1217c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024082368:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271711.014831:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736271711.014835:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271711.014837:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271711.014840:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024082240:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271711.014849:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024082432:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271711.014850:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082496 00000100:00100000:0.0:1736271711.014854:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:2.0:1736271711.014854:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1217c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024082368:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (77us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271711.014856:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024082688:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271711.014863:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:3.0:1736271711.014874:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271711.014876:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112798 00000100:00100000:2.0:1736271711.014879:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082560 00000100:00100000:1.0:1736271711.014881:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f127200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024082496:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271711.014888:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271711.014891:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271711.014892:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7043 00010000:02000000:1.0:1736271711.014893:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271711.014893:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf597c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024082368:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271711.014896:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024082560:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271711.014931:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f127200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024082496:12345-0@lo:38:kworker/u8:2.0 Request processed in 50us (114us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271711.014938:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112798 00000100:00100000:2.0:1736271711.014938:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024082560:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271711.014944:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7043 00000100:00080000:3.0:1736271711.014951:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271711.014954:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271711.014957:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024082496:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271711.014959:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082688 00000100:00100000:0.0:1736271711.014964:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf59300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024082560:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271711.014966:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024082432:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271711.014973:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1736271711.014976:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b150c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024082688:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271711.014982:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271711.015012:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b150c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024082688:12345-0@lo:38:kworker/u8:2.0 Request processed in 35us (138us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271711.015017:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00080000:3.0:1736271711.015036:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271711.015038:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271711.015041:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024082688:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271711.598531:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271712.600560:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271713.602488:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271714.604467:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271714.710480:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d4e1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024082752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271714.710515:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271714.710529:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf59300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024082816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271714.710541:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271714.710557:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271714.710581:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082752 00000100:00100000:1.0:1736271714.710583:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082816 00000100:00100000:2.0:1736271714.710638:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5842 00000100:00100000:2.0:1736271714.710643:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf584c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024082816:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271714.710661:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5843 00002000:00000024:2.0:1736271714.710665:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736271714.710665:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024082752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1736271714.710680:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271714.710711:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024082752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271714.710714:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf584c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024082816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271714.710716:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5843 00000100:00100000:2.0:1736271714.710728:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5842 00000100:00100000:1.0:1736271714.710784:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d4e1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024082752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271714.710795:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf59300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024082816:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271715.606470:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271715.788550:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271715.788599:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271715.788645:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271715.788751:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972928 00000100:00100000:2.0:1736271715.788788:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 248 00000100:00100000:2.0:1736271715.788794:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058972928:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271715.788848:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058972928:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 54us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271715.788854:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 248 00000100:00100000:3.0:1736271715.788948:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973056 00000100:00100000:3.0:1736271715.788975:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058972992 00000100:00100000:3.0:1736271715.788987:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 753 00000100:00100000:3.0:1736271715.788991:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf59300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058973056:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271715.788997:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1006 00000100:00100000:1.0:1736271715.789002:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058972992:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:3.0:1736271715.789016:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf59300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058973056:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271715.789020:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 753 00010000:02000000:1.0:1736271715.789022:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271715.789046:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058972992:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 43us (402us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271715.789052:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1006 00000100:00080000:0.0:1736271716.022465:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271716.022471:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271716.022474:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271716.022480:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8496 00000100:00080000:0.0:1736271716.022483:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271716.022487:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271716.022507:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5df00 x1820604024082944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271716.022546:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271716.022549:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271716.022550:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271716.022553:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8496 00000100:00080000:0.0:1736271716.022554:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271716.022558:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271716.022566:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf597c0 x1820604024083072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271716.022577:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736271716.022585:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024082880:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271716.022590:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271716.022591:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271716.022593:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8496 00000100:00080000:0.0:1736271716.022595:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271716.022597:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271716.022606:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf5c280 x1820604024083200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271716.022621:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271716.022624:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271716.022624:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271716.022627:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8496 00000100:00080000:0.0:1736271716.022627:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271716.022629:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271716.022637:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2cc00 x1820604024083392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271716.022651:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271716.022663:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024083136:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271716.022679:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024083328:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271716.022686:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271716.022712:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271716.022724:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736271716.022728:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024083264:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271716.022744:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271716.022751:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024083008:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271716.022769:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082880 00000100:00100000:3.0:1736271716.022771:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271716.022794:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083136 00000100:00100000:2.0:1736271716.022795:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1736271716.022799:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024082880:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271716.022811:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083008 00000100:00100000:3.0:1736271716.022813:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1736271716.022816:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024083136:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271716.022829:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024082880:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271716.022836:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1736271716.022836:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1736271716.022836:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024083136:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271716.022840:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b14740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024083008:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271716.022841:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1736271716.022857:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024082944:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271716.022869:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024082880:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271716.022874:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b14740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024083008:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271716.022874:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271716.022879:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1736271716.022883:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf597c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024083072:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271716.022891:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024082944 00000100:00100000:3.0:1736271716.022897:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271716.022901:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:2.0:1736271716.022901:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083328 00000100:00100000:1.0:1736271716.022903:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b14c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024082944:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271716.022913:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271716.022913:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024083200:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271716.022919:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083264 00000100:00100000:1.0:1736271716.022934:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b14c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024082944:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (59us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271716.022938:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7044 00000100:00100000:1.0:1736271716.022939:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:3.0:1736271716.022939:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271716.022941:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c484740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024083328:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271716.022947:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083072 00000100:00100000:3.0:1736271716.022948:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024083392:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271716.022960:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:1.0:1736271716.022962:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b12140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024083072:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271716.022963:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271716.022965:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c484740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024083328:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (255us total) trans 0 rc 0/0 00010000:02000000:1.0:1736271716.022968:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271716.022970:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7044 00000100:00100000:2.0:1736271716.022978:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7045 00000100:00080000:3.0:1736271716.022978:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271716.022980:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271716.022981:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c482f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024083264:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271716.022982:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024082944:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271716.022986:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b12140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024083072:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (88us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736271716.022989:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271716.022990:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271716.022991:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1736271716.022993:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf597c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024083072:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271716.022998:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c482f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024083264:12345-0@lo:400:kworker/u8:2.0 Request processed in 17us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271716.022999:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083392 00000100:00100000:2.0:1736271716.023002:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7045 00000100:00100000:1.0:1736271716.023006:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:1.0:1736271716.023009:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b11300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024083392:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271716.023020:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271716.023021:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024083264:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271716.023021:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024083008:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271716.023028:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024083328:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271716.023043:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b11300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024083392:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (80us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271716.023047:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083200 00000100:00100000:1.0:1736271716.023048:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:3.0:1736271716.023061:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112799 00000100:00100000:3.0:1736271716.023064:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024083200:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271716.023069:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271716.023090:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024083200:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (151us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271716.023095:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112799 00000100:00100000:0.0:1736271716.023123:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024083136:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271716.023287:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271716.023289:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271716.023291:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024083200:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271716.023295:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271716.023296:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271716.023297:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024083392:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271716.608476:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271717.610446:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271718.612479:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271719.614451:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271719.718459:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024083520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271719.718459:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d4e1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024083456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271719.718513:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271719.718552:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083520 00000100:00100000:3.0:1736271719.718554:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271719.718582:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083456 00000100:00100000:1.0:1736271719.718588:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5844 00000100:00100000:1.0:1736271719.718592:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4850c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024083520:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271719.718598:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5845 00000100:00100000:3.0:1736271719.718602:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b15f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024083456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736271719.718617:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:3.0:1736271719.718617:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271719.718657:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b15f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024083456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271719.718664:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5845 00000100:00100000:1.0:1736271719.718665:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4850c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024083520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271719.718671:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5844 00000100:00100000:2.0:1736271719.718692:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024083520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271719.718717:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d4e1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024083456:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271720.616469:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271720.796681:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271720.796731:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271720.796767:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271720.796797:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973184 00000100:00100000:0.0:1736271720.796804:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973248 00000100:00100000:2.0:1736271720.796806:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973120 00000100:00100000:1.0:1736271720.796842:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 756 00000100:00100000:0.0:1736271720.796847:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1010 00000100:00100000:1.0:1736271720.796850:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc29c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058973248:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271720.796851:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058973184:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:2.0:1736271720.796854:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 250 00000100:00100000:2.0:1736271720.796859:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058973120:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00010000:02000000:0.0:1736271720.796866:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271720.796916:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058973184:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 64us (244us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271720.796922:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1010 00000100:00100000:2.0:1736271720.796923:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058973120:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 62us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271720.796929:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc29c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058973248:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 80us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271720.796936:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 756 00000100:00100000:2.0:1736271720.796940:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 250 00000100:00080000:0.0:1736271721.030498:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271721.030506:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271721.030509:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271721.030516:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8501 00000100:00080000:0.0:1736271721.030521:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271721.030528:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271721.030549:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc297c0 x1820604024083648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271721.030551:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736271721.030573:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc28e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024083584:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271721.030597:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271721.030601:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271721.030602:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271721.030605:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8501 00000100:00080000:0.0:1736271721.030607:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271721.030611:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271721.030611:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271721.030622:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2f6c0 x1820604024083776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271721.030631:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024083712:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271721.030631:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024083648:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271721.030637:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271721.030650:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271721.030653:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271721.030654:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271721.030657:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8501 00000100:00080000:0.0:1736271721.030659:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271721.030662:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271721.030674:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc28980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024083840:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271721.030681:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271721.030688:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2c280 x1820604024083904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271721.030701:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271721.030704:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083584 00000100:00080000:0.0:1736271721.030714:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271721.030717:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271721.030718:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271721.030718:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc284c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024084032:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271721.030718:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1736271721.030721:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8501 00000100:00080000:0.0:1736271721.030723:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00100000:2.0:1736271721.030723:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024083968:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271721.030726:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271721.030730:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1736271721.030734:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc28000 x1820604024084096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271721.030734:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024083584:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271721.030744:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271721.030758:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083712 00000100:00100000:3.0:1736271721.030765:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024083584:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271721.030769:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1736271721.030773:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271721.030787:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084032 00000100:00100000:2.0:1736271721.030792:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083840 00000100:00100000:3.0:1736271721.030794:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:3.0:1736271721.030797:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024083712:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271721.030812:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083968 00000100:00100000:3.0:1736271721.030814:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024083712:12345-0@lo:400:kworker/u8:2.0 Request processed in 17us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271721.030818:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7046 00000100:00100000:2.0:1736271721.030818:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1736271721.030823:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4804c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024083840:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271721.030824:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024084032:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271721.030826:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:3.0:1736271721.030841:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271721.030843:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7047 00000100:00100000:1.0:1736271721.030846:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024083968:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271721.030857:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024083776:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271721.030876:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024084032:12345-0@lo:400:kworker/u8:2.0 Request processed in 52us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271721.030878:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4804c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024083840:12345-0@lo:400:kworker/u8:2.0 Request processed in 54us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271721.030879:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271721.030883:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7046 00000100:00100000:1.0:1736271721.030885:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024083968:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271721.030885:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1736271721.030892:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7047 00000100:00100000:3.0:1736271721.030892:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024083904:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271721.030897:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083648 00000100:00100000:3.0:1736271721.030906:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271721.030910:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083776 00000100:00100000:3.0:1736271721.030916:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024084096:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271721.030923:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1736271721.030925:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024083968:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271721.030925:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc284c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024084032:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271721.030925:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271721.030926:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b10980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024083648:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271721.030935:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024083712:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271721.030937:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc28980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024083840:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271721.030938:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084096 00010000:02000000:2.0:1736271721.030939:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271721.030946:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1736271721.030949:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b104c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024083776:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271721.030957:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271721.030969:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:2.0:1736271721.030972:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b10980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024083648:12345-0@lo:38:kworker/u8:2.0 Request processed in 45us (130us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271721.030973:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024084096:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271721.030974:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b104c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024083776:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (94us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271721.030978:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:3.0:1736271721.030980:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00010000:02000000:0.0:1736271721.030981:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271721.030994:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024083904 00000100:00100000:2.0:1736271721.031004:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc28e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024083584:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271721.031007:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024084096:12345-0@lo:38:kworker/u8:2.0 Request processed in 33us (80us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271721.031011:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112800 00000100:00100000:0.0:1736271721.031013:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1736271721.031014:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b16880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024083904:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271721.031022:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1736271721.031028:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271721.031036:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271721.031039:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024083776:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271721.031045:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b16880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024083904:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (137us total) trans 0 rc -19/-19 00000100:00080000:2.0:1736271721.031049:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271721.031050:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112800 00000100:00080000:2.0:1736271721.031051:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271721.031054:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024083904:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271721.031063:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271721.031065:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271721.031067:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024084096:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271721.031075:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271721.031077:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271721.031079:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024083648:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271721.618520:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271722.620471:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271723.622471:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271724.624439:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271724.726459:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271724.726461:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736271724.726474:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024084160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271724.726481:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc28980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024084224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271724.726526:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271724.726545:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084224 00000100:00100000:2.0:1736271724.726569:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271724.726577:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084160 00000100:00100000:1.0:1736271724.726591:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5846 00000100:00100000:1.0:1736271724.726595:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024084224:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271724.726597:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5847 00000100:00100000:2.0:1736271724.726601:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c485f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024084160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271724.726617:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:1.0:1736271724.726618:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271724.726655:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c485f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024084160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271724.726656:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024084224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271724.726661:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5847 00000100:00100000:1.0:1736271724.726664:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5846 00000100:00100000:3.0:1736271724.726682:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024084160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271724.726683:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc28980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024084224:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271725.626451:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271725.804556:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271725.804594:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271725.804626:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973312 00000100:00100000:0.0:1736271725.804641:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271725.804655:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973440 00000100:00100000:3.0:1736271725.804666:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 252 00000100:00100000:3.0:1736271725.804671:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058973312:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271725.804676:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973376 00000100:00100000:2.0:1736271725.804684:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 759 00000100:00100000:2.0:1736271725.804686:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc28980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058973440:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271725.804687:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1014 00000100:00100000:0.0:1736271725.804691:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc29300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058973376:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271725.804703:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271725.804737:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058973312:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 65us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271725.804744:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 252 00000100:00100000:2.0:1736271725.804748:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc28980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058973440:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 61us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271725.804751:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc29300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058973376:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 59us (110us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271725.804754:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 759 00000100:00100000:0.0:1736271725.804757:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1014 00000100:00080000:0.0:1736271726.038431:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271726.038441:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271726.038444:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271726.038450:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8506 00000100:00080000:0.0:1736271726.038453:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271726.038457:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271726.038460:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024084288:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271726.038474:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2e880 x1820604024084352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271726.038498:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024084352:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271726.038504:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271726.038508:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271726.038509:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271726.038512:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8506 00000100:00080000:0.0:1736271726.038513:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271726.038527:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271726.038533:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271726.038533:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271726.038536:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2d0c0 x1820604024084480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271726.038549:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271726.038552:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271726.038553:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271726.038555:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8506 00000100:00080000:0.0:1736271726.038556:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271726.038558:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271726.038565:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2af80 x1820604024084608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271726.038565:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024084480:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271726.038575:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024084544:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271726.038585:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271726.038600:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736271726.038601:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024084736:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271726.038603:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271726.038604:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271726.038606:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8506 00000100:00080000:0.0:1736271726.038607:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:3.0:1736271726.038609:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024084608:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271726.038610:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271726.038619:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc297c0 x1820604024084800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271726.038621:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271726.038630:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024084672:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271726.038631:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271726.038642:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084352 00000100:00100000:2.0:1736271726.038648:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084480 00000100:00100000:1.0:1736271726.038653:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271726.038655:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024084800:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271726.038663:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:0.0:1736271726.038667:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a4c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024084352:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271726.038667:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:2.0:1736271726.038671:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024084480:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271726.038671:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271726.038673:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084736 00010000:02000000:0.0:1736271726.038676:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736271726.038678:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271726.038685:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271726.038688:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084672 00000100:00100000:3.0:1736271726.038696:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736271726.038697:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7048 00000100:00100000:1.0:1736271726.038699:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c481c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024084736:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271726.038699:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024084416:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271726.038706:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024084480:12345-0@lo:38:kworker/u8:2.0 Request processed in 35us (121us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271726.038711:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a4c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024084352:12345-0@lo:38:kworker/u8:2.0 Request processed in 44us (177us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271726.038713:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:3.0:1736271726.038714:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271726.038716:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:1.0:1736271726.038722:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c481c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024084736:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271726.038723:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084800 00000100:00100000:1.0:1736271726.038725:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7048 00000100:00100000:3.0:1736271726.038726:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084544 00000100:00100000:2.0:1736271726.038730:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084416 00000100:00100000:1.0:1736271726.038732:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7049 00000100:00100000:1.0:1736271726.038733:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024084672:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271726.038734:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:0.0:1736271726.038738:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cef2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024084800:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271726.038741:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00010000:02000000:0.0:1736271726.038743:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271726.038744:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cef6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024084544:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271726.038744:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:1.0:1736271726.038745:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024084672:12345-0@lo:400:kworker/u8:2.0 Request processed in 11us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271726.038746:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024084416:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271726.038748:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7049 00000100:00100000:1.0:1736271726.038757:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084608 00000100:00100000:0.0:1736271726.038766:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cef2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024084800:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (94us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271726.038766:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112801 00000100:00100000:1.0:1736271726.038768:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b35bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024084608:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271726.038769:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024084416:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (55us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271726.038770:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cef6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024084544:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271726.038771:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00010000:02000000:1.0:1736271726.038773:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271726.038773:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:2.0:1736271726.038775:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1736271726.038784:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b35bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024084608:12345-0@lo:38:kworker/u8:2.0 Request processed in 15us (154us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271726.038787:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112801 00000100:00100000:3.0:1736271726.038793:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024084416:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271726.038798:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736271726.038799:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024084544:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271726.038800:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271726.038802:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024084800:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271726.038804:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024084672:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271726.038814:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271726.038815:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271726.038817:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024084608:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271726.038821:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271726.038822:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271726.038823:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024084480:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271726.038827:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271726.038828:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271726.038829:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024084352:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271726.038847:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024084736:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271726.038857:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084288 00000100:00100000:2.0:1736271726.038889:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1736271726.038892:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024084288:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271726.038930:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024084288:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271726.038936:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1736271726.038967:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024084288:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271726.628451:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271727.630463:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271728.632427:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271729.634452:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271729.734410:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024084864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271729.734436:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2c1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024084928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271729.734462:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271729.734487:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271729.734519:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084864 00000100:00100000:3.0:1736271729.734519:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084928 00000100:00100000:1.0:1736271729.734554:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5848 00000100:00100000:1.0:1736271729.734572:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024084864:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271729.734573:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5849 00000100:00100000:3.0:1736271729.734576:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024084928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1736271729.734591:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:1.0:1736271729.734592:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736271729.734618:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024084928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271729.734624:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5849 00000100:00100000:1.0:1736271729.734629:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024084864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271729.734633:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b2c1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024084928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271729.734635:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5848 00000100:00100000:3.0:1736271729.734660:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024084864:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271730.636450:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271730.812554:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271730.812603:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271730.812657:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271730.812692:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973504 00000100:00100000:0.0:1736271730.812698:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973568 00000100:00100000:3.0:1736271730.812702:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973632 00000100:00100000:0.0:1736271730.812729:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1018 00000100:00100000:0.0:1736271730.812735:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058973568:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:2.0:1736271730.812736:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 254 00000100:00100000:2.0:1736271730.812748:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058973504:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00010000:02000000:0.0:1736271730.812752:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271730.812759:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 762 00000100:00100000:3.0:1736271730.812765:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058973632:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271730.812795:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058973504:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 47us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271730.812796:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058973568:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 61us (139us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271730.812803:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1018 00000100:00100000:2.0:1736271730.812803:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 254 00000100:00100000:3.0:1736271730.812821:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058973632:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 56us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271730.812827:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 762 00000100:00080000:0.0:1736271731.046471:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271731.046476:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271731.046479:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271731.046485:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8511 00000100:00080000:0.0:1736271731.046489:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271731.046494:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271731.046511:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2b440 x1820604024085056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271731.046515:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc28e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024084992:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271731.046539:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271731.046541:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271731.046555:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271731.046557:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8511 00000100:00080000:0.0:1736271731.046558:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271731.046561:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271731.046567:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2ed40 x1820604024085184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271731.046568:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc284c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024085120:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271731.046572:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271731.046579:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024085056:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271731.046585:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271731.046587:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271731.046588:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271731.046590:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8511 00000100:00080000:0.0:1736271731.046591:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271731.046592:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271731.046600:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc28000 x1820604024085312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271731.046613:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271731.046615:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271731.046616:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271731.046617:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8511 00000100:00100000:1.0:1736271731.046617:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024085440:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271731.046618:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271731.046620:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271731.046624:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271731.046625:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2e880 x1820604024085504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271731.046633:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024085376:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271731.046646:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024085184:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271731.046648:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271731.046651:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024085248:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271731.046672:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085056 00000100:00100000:2.0:1736271731.046680:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271731.046692:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271731.046696:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024085312:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271731.046699:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085440 00000100:00100000:3.0:1736271731.046708:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085184 00000100:00100000:2.0:1736271731.046721:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271731.046721:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085248 00000100:00100000:2.0:1736271731.046731:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024085504:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271731.046734:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7050 00000100:00100000:0.0:1736271731.046741:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024084992 00000100:00100000:3.0:1736271731.046741:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:2.0:1736271731.046746:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271731.046746:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024085248:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271731.046765:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085504 00000100:00100000:0.0:1736271731.046775:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1736271731.046780:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024084992:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271731.046780:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1736271731.046784:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c483440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024085056:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271731.046794:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024085248:12345-0@lo:400:kworker/u8:2.0 Request processed in 48us (102us total) trans 0 rc 0/0 00010000:02000000:2.0:1736271731.046796:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271731.046800:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1736271731.046814:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1736271731.046817:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024084992:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271731.046817:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024085440:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271731.046818:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c486d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024085184:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271731.046823:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c483440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024085056:12345-0@lo:38:kworker/u8:2.0 Request processed in 38us (199us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271731.046824:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00010000:02000000:3.0:1736271731.046827:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271731.046828:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1736271731.046839:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1736271731.046842:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024085504:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271731.046847:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271731.046854:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024085440:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271731.046855:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c486d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024085184:12345-0@lo:38:kworker/u8:2.0 Request processed in 37us (174us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271731.046860:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7050 00000100:00100000:3.0:1736271731.046860:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1736271731.046866:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024085504:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (120us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271731.046871:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1736271731.046875:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024085248:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271731.046880:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271731.046897:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085312 00000100:00100000:1.0:1736271731.046904:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024085440:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271731.046906:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085376 00000100:00100000:3.0:1736271731.046909:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271731.046911:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112802 00000100:00100000:2.0:1736271731.046914:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c480980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024085312:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271731.046918:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc28e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024084992:0@lo:400:kworker/u8:2.0 00010000:02000000:2.0:1736271731.046919:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271731.046923:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7051 00000100:00100000:0.0:1736271731.046927:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024085376:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271731.046939:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c480980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024085312:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (217us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271731.046943:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112802 00000100:00100000:3.0:1736271731.046944:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085120 00000100:00100000:3.0:1736271731.046961:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:0.0:1736271731.046962:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024085376:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (82us total) trans 0 rc 0/0 00000100:00080000:2.0:1736271731.046962:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271731.046964:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271731.046965:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024085120:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271731.046967:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024085312:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271731.046968:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7051 00000100:00080000:2.0:1736271731.046973:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271731.046975:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271731.046977:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024085504:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271731.046983:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271731.046984:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271731.046986:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024085056:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271731.046993:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024085120:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (83us total) trans 0 rc 0/0 00000100:00080000:2.0:1736271731.046994:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271731.046995:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271731.046997:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024085184:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271731.046998:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:0.0:1736271731.047019:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc284c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024085120:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271731.047027:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024085376:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271731.638496:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271732.640452:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271733.642488:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271734.644490:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271734.742417:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736271734.742436:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024085568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271734.742442:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6ac2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024085632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271734.742495:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271734.742526:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271734.742551:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085568 00000100:00100000:3.0:1736271734.742552:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085632 00000100:00100000:3.0:1736271734.742580:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5850 00000100:00100000:3.0:1736271734.742583:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc284c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024085632:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271734.742594:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5851 00000100:00100000:1.0:1736271734.742603:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024085568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1736271734.742605:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:1.0:1736271734.742624:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271734.742639:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc284c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024085632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271734.742646:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5850 00000100:00100000:1.0:1736271734.742656:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024085568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271734.742666:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6ac2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024085632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271734.742672:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5851 00000100:00100000:2.0:1736271734.742678:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024085568:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271735.646483:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271735.820590:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271735.820628:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271735.820654:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271735.820660:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973696 00000100:00100000:0.0:1736271735.820682:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973760 00000100:00100000:3.0:1736271735.820684:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973824 00000100:00100000:2.0:1736271735.820699:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 256 00000100:00100000:0.0:1736271735.820705:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 765 00000100:00100000:0.0:1736271735.820708:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058973824:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271735.820709:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008faa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058973696:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271735.820713:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1022 00000100:00100000:3.0:1736271735.820716:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058973760:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736271735.820725:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271735.820752:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058973824:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 44us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271735.820754:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008faa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058973696:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 46us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271735.820754:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058973760:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 38us (126us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271735.820759:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 256 00000100:00100000:3.0:1736271735.820759:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1022 00000100:00100000:0.0:1736271735.820763:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 765 00000100:00080000:0.0:1736271736.054415:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271736.054423:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271736.054426:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271736.054432:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8516 00000100:00080000:0.0:1736271736.054435:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271736.054440:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271736.054448:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024085696:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271736.054456:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2d580 x1820604024085760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271736.054491:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271736.054494:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271736.054495:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271736.054498:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8516 00000100:00080000:0.0:1736271736.054499:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1736271736.054501:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1736271736.054502:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271736.054508:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2c740 x1820604024085888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271736.054514:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271736.054520:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271736.054522:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271736.054523:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271736.054525:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8516 00000100:00100000:3.0:1736271736.054526:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024085760:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271736.054527:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271736.054529:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271736.054530:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024085824:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271736.054536:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2ed40 x1820604024086016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271736.054551:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271736.054556:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024085952:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271736.054562:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271736.054565:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271736.054566:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271736.054569:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8516 00000100:00080000:0.0:1736271736.054570:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271736.054573:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271736.054573:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271736.054579:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc28000 x1820604024086208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271736.054593:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271736.054594:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085696 00000100:00100000:3.0:1736271736.054595:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024085888:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271736.054596:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024086144:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271736.054611:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271736.054620:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1736271736.054623:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008faab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024085696:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271736.054624:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271736.054626:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024086016:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271736.054642:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024086080:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271736.054648:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271736.054652:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086144 00000100:00100000:2.0:1736271736.054652:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008faab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024085696:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271736.054656:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1736271736.054658:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024086208:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271736.054670:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271736.054672:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7052 00000100:00100000:3.0:1736271736.054673:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271736.054676:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc28e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024086144:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271736.054678:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086016 00000100:00100000:2.0:1736271736.054691:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112803 00000100:00100000:2.0:1736271736.054695:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024086016:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271736.054697:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085760 00000100:00100000:0.0:1736271736.054701:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc28e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024086144:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (77us total) trans 0 rc 0/0 00010000:02000000:2.0:1736271736.054704:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271736.054706:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7052 00000100:00100000:1.0:1736271736.054709:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086080 00000100:00100000:3.0:1736271736.054712:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085824 00000100:00100000:3.0:1736271736.054727:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085888 00000100:00100000:2.0:1736271736.054731:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024086016:12345-0@lo:38:kworker/u8:2.0 Request processed in 36us (83us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271736.054732:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086208 00000100:00100000:0.0:1736271736.054735:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024086144:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271736.054737:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112803 00000100:00100000:3.0:1736271736.054739:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1736271736.054742:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7053 00000100:00100000:0.0:1736271736.054743:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024085696:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271736.054743:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ac2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024085824:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271736.054747:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ac4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024086080:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271736.054755:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271736.054763:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024085952 00000100:00100000:3.0:1736271736.054773:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ac2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024085824:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271736.054774:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:0.0:1736271736.054777:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024085952:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271736.054777:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736271736.054778:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00080000:2.0:1736271736.054780:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271736.054782:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024086016:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271736.054788:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1736271736.054790:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ac4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024086080:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271736.054791:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024085760:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271736.054796:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7053 00010000:02000000:3.0:1736271736.054797:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271736.054800:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024085952:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (45us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271736.054806:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1736271736.054806:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024085952:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271736.054815:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024085760:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (242us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271736.054820:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00080000:2.0:1736271736.054820:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271736.054822:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271736.054824:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024085760:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271736.054824:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1736271736.054825:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024085888:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271736.054830:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1736271736.054833:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024086208:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271736.054835:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736271736.054839:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271736.054857:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024085888:12345-0@lo:38:kworker/u8:2.0 Request processed in 32us (246us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271736.054860:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1736271736.054862:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024086208:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (189us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271736.054867:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00080000:2.0:1736271736.054869:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271736.054870:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271736.054872:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024086208:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271736.054877:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271736.054878:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271736.054879:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024085888:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271736.054887:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024086080:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271736.054905:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024085824:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271736.648447:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271737.650450:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271738.652445:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271739.654430:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271739.750445:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024086272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271739.750446:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024086336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271739.750511:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271739.750549:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271739.750559:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086272 00000100:00100000:3.0:1736271739.750582:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086336 00000100:00100000:0.0:1736271739.750596:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5852 00000100:00100000:0.0:1736271739.750602:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024086272:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271739.750609:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5853 00000100:00100000:3.0:1736271739.750612:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ac1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024086336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271739.750626:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:3.0:1736271739.750627:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736271739.750654:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ac1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024086336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271739.750657:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5853 00000100:00100000:0.0:1736271739.750661:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024086272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271739.750666:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5852 00000100:00100000:1.0:1736271739.750676:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024086336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271739.750676:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024086272:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271740.656438:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271740.828472:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271740.828521:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271740.828542:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973888 00000100:00100000:0.0:1736271740.828565:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271740.828581:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 258 00000100:00100000:1.0:1736271740.828584:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974016 00000100:00100000:3.0:1736271740.828586:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008faae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058973888:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271740.828599:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058973952 00000100:00100000:1.0:1736271740.828620:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 768 00000100:00100000:1.0:1736271740.828624:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058974016:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271740.828632:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1026 00000100:00100000:0.0:1736271740.828637:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058973952:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:3.0:1736271740.828646:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008faae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058973888:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 59us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271740.828648:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058974016:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 24us (129us total) trans 0 rc 0/0 00010000:02000000:0.0:1736271740.828649:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271740.828652:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 768 00000100:00100000:3.0:1736271740.828656:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 258 00000100:00100000:0.0:1736271740.828674:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058973952:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 37us (110us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271740.828679:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1026 00000100:00080000:0.0:1736271741.062429:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271741.062436:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271741.062439:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271741.062453:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8521 00000100:00080000:0.0:1736271741.062456:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271741.062460:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271741.062474:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024086400:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271741.062478:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2a140 x1820604024086464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271741.062518:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024086464:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271741.062523:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271741.062527:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271741.062528:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271741.062531:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8521 00000100:00080000:0.0:1736271741.062532:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271741.062535:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271741.062541:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271741.062545:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2c740 x1820604024086592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271741.062553:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271741.062565:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271741.062567:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271741.062567:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1736271741.062568:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736271741.062568:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024086592:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271741.062571:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8521 00000100:00100000:1.0:1736271741.062571:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024086528:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271741.062572:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271741.062575:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271741.062583:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc2d580 x1820604024086720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271741.062585:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271741.062585:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024086656:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271741.062597:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024086720:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271741.062604:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271741.062606:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086400 00000100:00080000:0.0:1736271741.062607:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271741.062608:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271741.062611:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8521 00000100:00100000:3.0:1736271741.062612:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271741.062617:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1736271741.062617:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271741.062620:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271741.062625:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736271741.062629:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024086784:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271741.062632:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbd580 x1820604024086912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271741.062634:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1736271741.062638:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086464 00000100:00100000:1.0:1736271741.062639:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008faae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024086400:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271741.062646:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271741.062652:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086592 00000100:00100000:3.0:1736271741.062656:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271741.062659:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086784 00000100:00100000:3.0:1736271741.062660:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024086848:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271741.062662:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086656 00000100:00100000:1.0:1736271741.062670:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008faae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024086400:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271741.062676:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:1.0:1736271741.062677:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1736271741.062677:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271741.062686:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086848 00000100:00100000:2.0:1736271741.062692:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024086656:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271741.062693:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:3.0:1736271741.062695:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024086464:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271741.062697:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7054 00000100:00100000:0.0:1736271741.062700:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024086784:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271741.062702:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7055 00010000:02000000:3.0:1736271741.062705:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271741.062706:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024086848:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271741.062726:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024086656:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271741.062726:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024086464:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (173us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271741.062729:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:0.0:1736271741.062732:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024086784:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271741.062736:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7054 00000100:00100000:1.0:1736271741.062738:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024086848:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (61us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271741.062739:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:1.0:1736271741.062743:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7055 00000100:00100000:3.0:1736271741.062743:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1736271741.062746:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024086592:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271741.062749:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271741.062758:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086720 00000100:00100000:3.0:1736271741.062760:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024086592:12345-0@lo:38:kworker/u8:2.0 Request processed in 14us (176us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271741.062762:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1736271741.062771:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112804 00000100:00100000:2.0:1736271741.062774:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024086720:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271741.062776:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024086848:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271741.062779:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024086784:0@lo:400:kworker/u8:2.0 00010000:02000000:2.0:1736271741.062780:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271741.062784:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024086656:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271741.062792:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271741.062801:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024086720:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (184us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271741.062805:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112804 00000100:00100000:3.0:1736271741.062808:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086528 00000100:00100000:1.0:1736271741.062813:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024086400:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271741.062819:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1736271741.062821:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ac5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024086528:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271741.062838:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ac5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024086528:12345-0@lo:400:kworker/u8:2.0 Request processed in 16us (46us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271741.062841:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1736271741.062855:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024086528:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271741.062916:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024086912:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271741.062940:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271741.062964:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271741.062966:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271741.062969:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024086720:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271741.062976:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271741.062977:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271741.062977:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086912 00000100:00100000:0.0:1736271741.062979:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024086592:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271741.062985:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271741.062987:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271741.062989:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024086464:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271741.062994:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1736271741.062996:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbd0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024086912:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271741.063000:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271741.063017:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbd0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024086912:12345-0@lo:38:kworker/u8:2.0 Request processed in 20us (77us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271741.063019:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00080000:0.0:1736271741.063034:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271741.063037:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271741.063052:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024086912:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271741.658458:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271742.660445:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271743.662426:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271744.664429:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271744.758427:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736271744.758433:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736271744.758444:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024086976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271744.758444:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6ac4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024087040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271744.758503:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271744.758525:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271744.758545:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024086976 00000100:00100000:1.0:1736271744.758579:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087040 00000100:00100000:1.0:1736271744.758607:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5854 00000100:00100000:1.0:1736271744.758612:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ac2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024086976:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271744.758613:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5855 00000100:00100000:3.0:1736271744.758618:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf597c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024087040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1736271744.758634:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:3.0:1736271744.758635:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736271744.758663:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ac2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024086976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271744.758666:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf597c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024087040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271744.758669:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5854 00000100:00100000:3.0:1736271744.758682:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5855 00000100:00100000:2.0:1736271744.758688:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6ac4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024087040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271744.758695:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024086976:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271745.666452:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271745.836567:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271745.836603:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271745.836636:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974208 00000100:00100000:0.0:1736271745.836642:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271745.836665:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974080 00000100:00100000:0.0:1736271745.836675:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974144 00000100:00100000:2.0:1736271745.836678:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 771 00000100:00100000:2.0:1736271745.836684:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058974208:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271745.836700:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 260 00000100:00100000:0.0:1736271745.836702:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1030 00000100:00100000:3.0:1736271745.836704:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058974080:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271745.836705:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058974144:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271745.836716:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271745.836741:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058974208:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 57us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271745.836744:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058974144:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 38us (103us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271745.836744:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058974080:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 39us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271745.836748:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 771 00000100:00100000:0.0:1736271745.836752:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1030 00000100:00100000:3.0:1736271745.836753:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 260 00000100:00080000:0.0:1736271746.070423:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271746.070429:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271746.070431:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271746.070443:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8526 00000100:00080000:0.0:1736271746.070446:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271746.070452:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271746.070458:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbe880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024087104:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271746.070470:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fb8e40 x1820604024087168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271746.070501:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271746.070504:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271746.070505:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271746.070507:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8526 00000100:00080000:0.0:1736271746.070508:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271746.070511:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271746.070523:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271746.070528:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbb440 x1820604024087296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271746.070539:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271746.070541:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024087168:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271746.070542:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271746.070543:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271746.070545:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8526 00000100:00080000:0.0:1736271746.070546:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271746.070549:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271746.070556:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbc740 x1820604024087424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271746.070573:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271746.070579:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087104 00000100:00100000:1.0:1736271746.070587:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbb440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024087296:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271746.070590:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736271746.070591:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087168 00000100:00080000:0.0:1736271746.070592:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271746.070593:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271746.070596:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8526 00000100:00080000:0.0:1736271746.070597:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271746.070599:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271746.070605:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbcc00 x1820604024087616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271746.070612:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1736271746.070612:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1736271746.070613:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271746.070617:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ac4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024087168:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271746.070617:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024087104:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271746.070622:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024087360:0@lo:400:kworker/u8:2.0 00010000:02000000:2.0:1736271746.070627:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271746.070635:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024087424:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271746.070651:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271746.070657:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271746.070659:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024087104:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271746.070660:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ac4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024087168:12345-0@lo:38:kworker/u8:2.0 Request processed in 43us (87us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271746.070665:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1736271746.070666:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1736271746.070669:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbcc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024087616:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271746.070670:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271746.070674:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024087232:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271746.070677:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087296 00000100:00100000:1.0:1736271746.070685:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271746.070688:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087360 00000100:00100000:3.0:1736271746.070689:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024087488:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271746.070697:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087616 00000100:00100000:2.0:1736271746.070701:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1736271746.070704:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024087360:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271746.070709:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1736271746.070712:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271746.070713:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea66d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024087296:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271746.070716:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271746.070719:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271746.070722:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024087168:0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271746.070726:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271746.070728:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271746.070731:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024087360:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271746.070733:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024087552:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271746.070736:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1736271746.070745:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1736271746.070748:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087424 00000100:00100000:2.0:1736271746.070748:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea62f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024087616:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271746.070751:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea66d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024087296:12345-0@lo:38:kworker/u8:2.0 Request processed in 38us (138us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271746.070751:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:2.0:1736271746.070754:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271746.070756:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1736271746.070763:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112805 00000100:00100000:1.0:1736271746.070766:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea60980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024087424:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271746.070768:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271746.070768:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea62f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024087616:12345-0@lo:38:kworker/u8:2.0 Request processed in 20us (83us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271746.070771:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1736271746.070772:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087488 00010000:02000000:1.0:1736271746.070773:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271746.070780:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087232 00000100:00100000:0.0:1736271746.070784:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024087360:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271746.070789:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:2.0:1736271746.070791:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fb8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024087232:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271746.070791:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087552 00000100:00100000:1.0:1736271746.070799:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea60980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024087424:12345-0@lo:38:kworker/u8:2.0 Request processed in 32us (141us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736271746.070801:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271746.070803:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271746.070804:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112805 00000100:00100000:3.0:1736271746.070804:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7056 00000100:00100000:0.0:1736271746.070805:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024087424:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271746.070808:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024087488:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271746.070812:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271746.070813:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271746.070815:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbcc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024087616:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271746.070821:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271746.070822:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fb8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024087232:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (53us total) trans 0 rc 0/0 00000100:00080000:0.0:1736271746.070823:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271746.070825:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbb440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024087296:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271746.070826:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7057 00000100:00100000:2.0:1736271746.070827:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:1.0:1736271746.070829:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024087552:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271746.070836:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024087488:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271746.070842:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7056 00000100:00100000:0.0:1736271746.070848:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024087232:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271746.070852:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024087552:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271746.070858:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7057 00000100:00100000:2.0:1736271746.070858:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbe880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024087104:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271746.070879:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024087552:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271746.070887:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024087488:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271746.668443:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271747.670421:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271748.672443:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271749.674407:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271749.766451:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024087680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271749.766457:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf5df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024087744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271749.766516:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271749.766556:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271749.766561:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087744 00000100:00100000:1.0:1736271749.766590:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087680 00000100:00100000:2.0:1736271749.766600:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5856 00000100:00100000:1.0:1736271749.766604:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5857 00000100:00100000:2.0:1736271749.766604:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fb97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024087744:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271749.766607:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024087680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736271749.766623:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271749.766623:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736271749.766660:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024087680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271749.766663:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fb97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024087744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271749.766666:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5857 00000100:00100000:2.0:1736271749.766668:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5856 00000100:00100000:0.0:1736271749.766681:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf5df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024087744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271749.766681:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024087680:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271750.676445:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271750.844594:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271750.844642:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271750.844691:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271750.844691:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974272 00000100:00100000:3.0:1736271750.844711:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974400 00000100:00100000:0.0:1736271750.844738:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974336 00000100:00100000:2.0:1736271750.844742:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 262 00000100:00100000:3.0:1736271750.844742:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 774 00000100:00100000:2.0:1736271750.844747:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058974272:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271750.844747:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058974400:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271750.844791:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1034 00000100:00100000:0.0:1736271750.844796:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058974336:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271750.844813:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271750.844821:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058974272:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 74us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271750.844822:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058974400:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271750.844827:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 262 00000100:00100000:3.0:1736271750.844828:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 774 00000100:00100000:0.0:1736271750.844853:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058974336:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 56us (161us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271750.844859:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1034 00000100:00080000:0.0:1736271751.078491:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271751.078497:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271751.078500:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271751.078505:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8531 00000100:00080000:0.0:1736271751.078509:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271751.078514:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271751.078522:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024087808:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271751.078531:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fb9300 x1820604024087872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271751.078562:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271751.078566:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271751.078567:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271751.078569:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8531 00000100:00080000:0.0:1736271751.078571:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271751.078574:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271751.078582:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbdf00 x1820604024088000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271751.078582:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024087936:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271751.078585:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271751.078598:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024087872:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271751.078600:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271751.078603:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271751.078604:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271751.078612:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8531 00000100:00080000:0.0:1736271751.078614:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271751.078617:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271751.078626:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbc280 x1820604024088128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271751.078626:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fba600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024088064:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271751.078642:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271751.078645:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271751.078648:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271751.078649:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271751.078651:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbe3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024088192:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271751.078652:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8531 00000100:00080000:0.0:1736271751.078653:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271751.078656:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271751.078660:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087808 00000100:00100000:0.0:1736271751.078664:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbb900 x1820604024088320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271751.078686:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271751.078689:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087936 00000100:00100000:3.0:1736271751.078689:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1736271751.078691:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271751.078693:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024088256:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271751.078694:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024087808:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271751.078714:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:1.0:1736271751.078717:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088192 00000100:00100000:0.0:1736271751.078718:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024087936:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271751.078719:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271751.078727:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024087808:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271751.078733:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1736271751.078740:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088256 00000100:00100000:2.0:1736271751.078752:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7058 00000100:00100000:0.0:1736271751.078758:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024087936:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271751.078763:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7059 00000100:00100000:0.0:1736271751.078766:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1736271751.078766:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea63900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024088192:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271751.078768:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024088256:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271751.078783:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024087808:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271751.078794:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024088256:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271751.078799:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7059 00000100:00100000:2.0:1736271751.078812:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea63900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024088192:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271751.078817:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271751.078818:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7058 00000100:00100000:0.0:1736271751.078829:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbe3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024088192:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271751.078829:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbdf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024088000:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271751.078846:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271751.078851:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024087872 00000100:00100000:1.0:1736271751.078881:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088064 00000100:00100000:0.0:1736271751.078882:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1736271751.078886:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea67200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024087872:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271751.078895:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271751.078899:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:2.0:1736271751.078901:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024088256:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271751.078902:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024088064:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271751.078911:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024087936:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271751.078924:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea67200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024087872:12345-0@lo:38:kworker/u8:2.0 Request processed in 37us (106us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271751.078933:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024088064:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271751.078935:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1736271751.078938:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:3.0:1736271751.078951:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fba600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024088064:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271751.078953:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271751.078967:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024088128:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271751.078972:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088000 00000100:00100000:1.0:1736271751.078987:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271751.078993:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1736271751.078996:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea65f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024088000:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271751.078996:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024088320:0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271751.079002:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271751.079004:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088128 00000100:00100000:1.0:1736271751.079010:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271751.079019:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112806 00000100:00100000:3.0:1736271751.079022:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea64740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024088128:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271751.079025:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea65f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024088000:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (71us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736271751.079026:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271751.079027:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271751.079027:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088320 00010000:02000000:3.0:1736271751.079029:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271751.079030:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1736271751.079030:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024087872:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271751.079040:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:0.0:1736271751.079043:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea62600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024088320:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271751.079043:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271751.079045:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271751.079047:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbdf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024088000:0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271751.079048:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271751.079049:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea64740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024088128:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (62us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271751.079053:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112806 00000100:00080000:1.0:1736271751.079063:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271751.079065:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea62600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024088320:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (55us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736271751.079065:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271751.079067:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024088128:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271751.079070:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00080000:1.0:1736271751.079074:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271751.079075:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271751.079077:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024088320:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271751.678497:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271752.680430:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271753.682458:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271754.684426:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271754.774408:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1736271754.774425:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbe3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024088384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271754.774483:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271754.774518:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2c4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024088448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271754.774535:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271754.774575:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088384 00000100:00100000:2.0:1736271754.774590:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088448 00000100:00100000:1.0:1736271754.774611:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5858 00000100:00100000:1.0:1736271754.774615:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c5580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024088384:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271754.774626:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5859 00000100:00100000:2.0:1736271754.774630:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c2f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024088448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736271754.774642:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271754.774645:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:1.0:1736271754.774683:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c5580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024088384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271754.774689:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5858 00000100:00100000:2.0:1736271754.774689:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c2f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024088448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271754.774695:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5859 00000100:00100000:3.0:1736271754.774695:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbe3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024088384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271754.774706:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b2c4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024088448:0@lo:13:osp-pre-1-1.0 00000020:02000400:0.0:1736271755.567370:0:19949:0:(genops.c:1786:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 128 seconds. The obd refcount = 4. Is it stuck? 00000020:02000400:0.0:1736271755.570785:0:19949:0:(genops.c:1752:print_export_data()) lustre-MDT0000: UNLINKED ffff88008faa8000 64bb3b11-afd7-4230-a38c-2a374f07ba02 192.168.203.38@tcp 1 (0 0 0) 1 0 1 0: (null) 523986010115 stale:0 00010000:00010000:2.0:1736271755.686426:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271755.852586:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271755.852628:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271755.852665:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974464 00000100:00100000:0.0:1736271755.852671:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271755.852711:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 264 00000100:00100000:2.0:1736271755.852716:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058974464:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271755.852724:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974592 00000100:00100000:3.0:1736271755.852730:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974528 00000100:00100000:1.0:1736271755.852754:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 777 00000100:00100000:1.0:1736271755.852759:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058974592:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271755.852759:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1038 00000100:00100000:3.0:1736271755.852764:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fba140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058974528:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736271755.852775:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271755.852785:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058974464:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 68us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271755.852789:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058974592:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 30us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271755.852791:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 264 00000100:00100000:3.0:1736271755.852800:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fba140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058974528:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 36us (130us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271755.852801:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 777 00000100:00100000:3.0:1736271755.852814:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1038 00000100:00080000:0.0:1736271756.086438:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271756.086445:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271756.086448:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271756.086453:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8536 00000100:00080000:0.0:1736271756.086457:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271756.086463:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271756.086469:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024088512:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271756.086493:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fb9c80 x1820604024088576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271756.086524:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271756.086527:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271756.086528:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271756.086531:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8536 00000100:00100000:3.0:1736271756.086532:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271756.086533:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00100000:1.0:1736271756.086533:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024088576:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271756.086537:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271756.086546:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbb900 x1820604024088704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271756.086565:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271756.086568:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271756.086569:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271756.086571:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8536 00000100:00080000:0.0:1736271756.086572:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271756.086575:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271756.086584:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbdf00 x1820604024088832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271756.086600:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271756.086603:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271756.086604:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271756.086606:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8536 00000100:00100000:1.0:1736271756.086606:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271756.086608:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271756.086611:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271756.086611:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024088896:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271756.086612:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fba600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024088960:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271756.086618:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbaac0 x1820604024089024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271756.086627:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024088704:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271756.086634:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271756.086648:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088576 00000100:00100000:3.0:1736271756.086652:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736271756.086654:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271756.086656:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbe3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024088640:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271756.086657:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088960 00000100:00100000:1.0:1736271756.086666:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbdf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024088832:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271756.086669:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271756.086670:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088704 00000100:00100000:2.0:1736271756.086679:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088640 00000100:00100000:0.0:1736271756.086683:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7060 00000100:00100000:0.0:1736271756.086687:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024088960:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271756.086687:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271756.086690:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1736271756.086693:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea676c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024088576:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271756.086703:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00010000:02000000:3.0:1736271756.086703:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271756.086707:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024088640:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271756.086723:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea676c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024088576:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (118us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271756.086728:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:0.0:1736271756.086732:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024088960:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271756.086737:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7060 00000100:00100000:2.0:1736271756.086739:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024088640:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (69us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271756.086741:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1736271756.086744:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea64c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024088704:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271756.086748:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271756.086751:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1736271756.086762:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea64c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024088704:12345-0@lo:38:kworker/u8:2.0 Request processed in 17us (108us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271756.086766:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1736271756.086777:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271756.086790:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbe3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024088640:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271756.086792:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271756.086793:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088896 00000100:00100000:2.0:1736271756.086797:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024088768:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271756.086798:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fba600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024088960:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271756.086808:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7061 00000100:00100000:0.0:1736271756.086811:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024088896:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271756.086815:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271756.086825:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088768 00000100:00100000:2.0:1736271756.086836:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088512 00000100:00100000:0.0:1736271756.086841:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024088896:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (64us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271756.086841:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:3.0:1736271756.086844:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024088768:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271756.086846:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7061 00000100:00100000:2.0:1736271756.086855:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1736271756.086858:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024088512:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271756.086865:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024088768:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (50us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271756.086870:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:2.0:1736271756.086885:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024088512:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271756.086891:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1736271756.086896:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024088512:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271756.086913:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024088832 00000100:00100000:2.0:1736271756.086920:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024088768:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271756.086922:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271756.086925:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271756.086926:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112807 00000100:00100000:1.0:1736271756.086929:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024088576:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271756.086929:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024088896:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271756.086929:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea66880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024088832:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271756.086934:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271756.086942:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024089024:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271756.086950:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea66880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024088832:12345-0@lo:38:kworker/u8:2.0 Request processed in 21us (263us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271756.086954:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112807 00000100:00100000:1.0:1736271756.086969:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736271756.086982:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271756.086984:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271756.086985:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089024 00000100:00100000:1.0:1736271756.086992:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024088704:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271756.086998:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271756.087000:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271756.087002:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbdf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024088832:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271756.087003:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1736271756.087006:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea63dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024089024:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271756.087010:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271756.087037:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea63dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024089024:12345-0@lo:38:kworker/u8:2.0 Request processed in 30us (68us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271756.087041:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00080000:0.0:1736271756.087094:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271756.087098:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271756.087101:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024089024:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271756.688430:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271757.690456:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271758.692433:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271759.694489:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271759.782490:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736271759.782507:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024089088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271759.782526:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271759.782534:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024089152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271759.782565:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271759.782581:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271759.782610:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089088 00000100:00100000:0.0:1736271759.782612:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089152 00000100:00100000:0.0:1736271759.782639:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5860 00000100:00100000:0.0:1736271759.782643:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024089152:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271759.782644:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5861 00000100:00100000:1.0:1736271759.782648:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024089088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271759.782665:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:1.0:1736271759.782665:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:1.0:1736271759.782696:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024089088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271759.782698:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024089152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271759.782705:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5860 00000100:00100000:3.0:1736271759.782716:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024089088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271759.782717:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5861 00000100:00100000:2.0:1736271759.782753:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024089152:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271760.696443:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271760.860543:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271760.860576:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271760.860606:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271760.860610:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974656 00000100:00100000:0.0:1736271760.860631:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974784 00000100:00100000:2.0:1736271760.860639:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974720 00000100:00100000:0.0:1736271760.860657:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 780 00000100:00100000:3.0:1736271760.860658:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 266 00000100:00100000:0.0:1736271760.860662:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058974784:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271760.860662:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1042 00000100:00100000:3.0:1736271760.860662:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058974656:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271760.860666:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbf200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058974720:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:2.0:1736271760.860682:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271760.860721:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058974656:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271760.860722:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058974784:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 59us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271760.860723:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbf200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058974720:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 56us (116us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271760.860728:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 780 00000100:00100000:3.0:1736271760.860728:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 266 00000100:00100000:2.0:1736271760.860732:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1042 00000100:00080000:0.0:1736271761.094530:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271761.094535:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271761.094537:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271761.094542:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8541 00000100:00080000:0.0:1736271761.094544:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271761.094549:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271761.094563:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fb8e40 x1820604024089280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271761.094590:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbe880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024089216:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271761.094597:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024089280:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271761.094598:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271761.094601:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271761.094602:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271761.094605:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8541 00000100:00080000:0.0:1736271761.094607:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271761.094611:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271761.094620:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbaac0 x1820604024089408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271761.094633:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271761.094646:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1736271761.094646:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024089344:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271761.094647:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271761.094650:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8541 00000100:00080000:0.0:1736271761.094651:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271761.094654:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271761.094665:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbb900 x1820604024089536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271761.094672:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271761.094675:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271761.094685:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271761.094688:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271761.094689:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271761.094692:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8541 00000100:00080000:0.0:1736271761.094694:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271761.094696:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271761.094704:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbc280 x1820604024089728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271761.094718:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089280 00000100:00100000:1.0:1736271761.094726:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024089408:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271761.094729:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024089664:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271761.094731:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbdf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024089472:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271761.094745:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271761.094745:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1736271761.094750:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a833900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024089280:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271761.094756:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271761.094759:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024089536:0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271761.094762:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271761.094763:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271761.094770:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736271761.094774:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024089600:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271761.094789:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271761.094795:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271761.094798:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089408 00000100:00100000:1.0:1736271761.094803:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024089728:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271761.094804:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a833900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024089280:12345-0@lo:38:kworker/u8:2.0 Request processed in 53us (129us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271761.094810:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1736271761.094813:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089472 00000100:00100000:3.0:1736271761.094821:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1736271761.094822:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271761.094823:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089664 00000100:00100000:3.0:1736271761.094824:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a834c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024089408:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271761.094828:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271761.094834:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089728 00000100:00100000:0.0:1736271761.094842:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00080000:1.0:1736271761.094842:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271761.094844:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271761.094845:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a834c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024089408:12345-0@lo:38:kworker/u8:2.0 Request processed in 21us (100us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271761.094846:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024089472:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271761.094848:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024089280:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271761.094848:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089600 00000100:00100000:3.0:1736271761.094850:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1736271761.094859:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7062 00000100:00100000:3.0:1736271761.094861:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1736271761.094862:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf58e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024089664:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271761.094864:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736271761.094864:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a8376c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024089728:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271761.094865:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271761.094867:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024089408:0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271761.094875:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271761.094879:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024089472:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271761.094884:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1736271761.094901:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7063 00000100:00100000:1.0:1736271761.094905:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf5c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024089600:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271761.094910:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf58e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024089664:12345-0@lo:400:kworker/u8:2.0 Request processed in 46us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271761.094911:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbdf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024089472:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271761.094911:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a8376c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024089728:12345-0@lo:38:kworker/u8:2.0 Request processed in 45us (88us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271761.094917:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7062 00000100:00100000:3.0:1736271761.094917:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1736271761.094932:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf5c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024089600:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271761.094934:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089536 00000100:00100000:1.0:1736271761.094938:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7063 00000100:00100000:3.0:1736271761.094948:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112808 00000100:00100000:3.0:1736271761.094951:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a832600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024089536:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271761.094953:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089216 00000100:00100000:2.0:1736271761.094957:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024089600:0@lo:400:kworker/u8:2.0 00010000:02000000:3.0:1736271761.094957:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736271761.094961:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271761.094963:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271761.094966:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024089728:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271761.094966:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024089664:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271761.094971:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1736271761.094975:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024089216:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271761.094982:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a832600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024089536:12345-0@lo:38:kworker/u8:2.0 Request processed in 30us (193us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736271761.094984:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271761.094986:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271761.094988:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024089536:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271761.094993:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112808 00000100:00100000:0.0:1736271761.095005:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024089216:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271761.095009:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbe880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024089216:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271761.095009:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271761.095011:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1736271761.095042:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089344 00000100:00100000:1.0:1736271761.095059:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:1.0:1736271761.095062:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024089344:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271761.095103:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024089344:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271761.095108:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1736271761.095137:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024089344:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271761.698458:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271762.700467:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271763.702472:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271764.704464:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271764.790431:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b281c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024089792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271764.790449:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbdf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024089856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271764.790490:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271764.790526:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089792 00000100:00100000:2.0:1736271764.790535:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271764.790571:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089856 00000100:00100000:0.0:1736271764.790587:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5862 00000100:00100000:0.0:1736271764.790592:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024089792:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271764.790594:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5863 00000100:00100000:3.0:1736271764.790598:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b283900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024089856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271764.790615:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:3.0:1736271764.790615:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271764.790647:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b283900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024089856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271764.790652:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024089792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271764.790654:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5863 00000100:00100000:0.0:1736271764.790658:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5862 00000100:00100000:2.0:1736271764.790669:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbdf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024089856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271764.790697:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b281c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024089792:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271765.706437:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271765.868547:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271765.868581:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271765.868613:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271765.868615:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974848 00000100:00100000:1.0:1736271765.868645:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974976 00000100:00100000:2.0:1736271765.868649:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 268 00000100:00100000:2.0:1736271765.868661:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058974848:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271765.868670:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058974912 00000100:00100000:3.0:1736271765.868679:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 783 00000100:00100000:3.0:1736271765.868683:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fba600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058974976:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271765.868684:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1046 00000100:00100000:1.0:1736271765.868688:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbe3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058974912:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271765.868700:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271765.868723:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fba600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058974976:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 39us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271765.868724:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058974848:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 62us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271765.868725:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbe3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058974912:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 36us (112us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271765.868728:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 783 00000100:00100000:2.0:1736271765.868730:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 268 00000100:00100000:1.0:1736271765.868731:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1046 00000100:00080000:0.0:1736271766.102431:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271766.102438:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271766.102441:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271766.102446:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8546 00000100:00080000:0.0:1736271766.102450:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271766.102455:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271766.102463:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbdf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024089920:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271766.102472:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fb84c0 x1820604024089984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271766.102499:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024089984:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271766.102510:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271766.102521:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271766.102523:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271766.102524:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271766.102528:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8546 00000100:00080000:0.0:1736271766.102530:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1736271766.102532:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271766.102533:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271766.102544:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbb900 x1820604024090112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271766.102544:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbe880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024090048:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271766.102554:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024090112:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271766.102565:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271766.102566:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089984 00000100:00080000:0.0:1736271766.102567:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271766.102568:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271766.102571:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8546 00000100:00080000:0.0:1736271766.102572:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1736271766.102572:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271766.102575:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271766.102578:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024089920 00000100:00100000:0.0:1736271766.102583:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbc280 x1820604024090240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271766.102588:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090048 00000100:00100000:2.0:1736271766.102600:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1736271766.102601:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1736271766.102601:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271766.102603:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271766.102604:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024090048:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271766.102605:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024089920:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271766.102606:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271766.102607:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271766.102609:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8546 00000100:00080000:0.0:1736271766.102610:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271766.102613:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271766.102613:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024090240:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271766.102621:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fb8e40 x1820604024090432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271766.102632:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271766.102635:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024090048:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (64us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271766.102637:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024089920:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271766.102639:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024090176:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271766.102640:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:2.0:1736271766.102643:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1736271766.102644:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024090432:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271766.102650:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090112 00000100:00100000:1.0:1736271766.102657:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:1.0:1736271766.102659:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b281c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024089984:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271766.102662:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024090304:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271766.102664:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:1.0:1736271766.102667:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271766.102677:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090176 00000100:00100000:2.0:1736271766.102686:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271766.102688:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b281c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024089984:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (156us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271766.102693:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1736271766.102696:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:3.0:1736271766.102699:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024090176:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271766.102702:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1736271766.102706:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024090112:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271766.102709:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090304 00010000:02000000:0.0:1736271766.102713:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271766.102718:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024090368:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271766.102725:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7064 00000100:00100000:2.0:1736271766.102728:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b282f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024090304:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271766.102728:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024090176:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (64us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271766.102733:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1736271766.102737:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024090112:12345-0@lo:38:kworker/u8:2.0 Request processed in 30us (135us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271766.102740:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271766.102742:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:2.0:1736271766.102752:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b282f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024090304:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (67us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271766.102757:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7064 00000100:00100000:1.0:1736271766.102763:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbdf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024089920:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271766.102764:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090368 00000100:00100000:3.0:1736271766.102765:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbe880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024090048:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271766.102766:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024090176:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271766.102775:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7065 00000100:00100000:2.0:1736271766.102778:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a835a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024090368:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271766.102782:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271766.102784:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090240 00000100:00100000:3.0:1736271766.102799:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112809 00000100:00100000:3.0:1736271766.102802:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024090240:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271766.102809:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271766.102811:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a835a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024090368:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (72us total) trans 0 rc 0/0 00000100:00080000:0.0:1736271766.102812:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271766.102814:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271766.102816:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7065 00000100:00100000:0.0:1736271766.102817:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024090112:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271766.102820:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024090368:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271766.102824:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271766.102826:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271766.102828:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024089984:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271766.102829:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024090240:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (196us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271766.102834:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024090304:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271766.102834:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112809 00000100:00080000:0.0:1736271766.102849:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271766.102851:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271766.102853:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024090240:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271766.102880:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090432 00000100:00100000:0.0:1736271766.102907:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1736271766.102910:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024090432:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271766.102916:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271766.102940:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024090432:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (157us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271766.102945:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00080000:2.0:1736271766.102949:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271766.102951:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271766.102954:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024090432:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271766.708436:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271767.710463:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271768.712426:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271769.714442:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271769.798454:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271769.798459:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271769.798472:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2804c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024090496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271769.798480:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009351d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024090560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271769.798533:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271769.798534:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271769.798577:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090496 00000100:00100000:1.0:1736271769.798578:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090560 00000100:00100000:1.0:1736271769.798610:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5864 00000100:00100000:1.0:1736271769.798615:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fb8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024090560:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271769.798625:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5865 00000100:00100000:0.0:1736271769.798628:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024090496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736271769.798639:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:0.0:1736271769.798643:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271769.798671:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024090496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271769.798675:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fb8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024090560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271769.798677:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5865 00000100:00100000:1.0:1736271769.798681:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5864 00000100:00100000:2.0:1736271769.798688:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009351d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024090560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271769.798712:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b2804c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024090496:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271770.716446:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271770.876501:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271770.876537:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271770.876583:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975040 00000100:00100000:0.0:1736271770.876610:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271770.876639:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 270 00000100:00100000:3.0:1736271770.876646:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058975040:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271770.876648:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975168 00000100:00100000:0.0:1736271770.876649:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975104 00000100:00100000:0.0:1736271770.876667:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1050 00000100:00100000:0.0:1736271770.876671:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058975104:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271770.876685:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271770.876711:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058975104:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 39us (100us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271770.876712:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058975040:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 65us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271770.876715:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 786 00000100:00100000:3.0:1736271770.876719:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 270 00000100:00100000:0.0:1736271770.876734:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1050 00000100:00100000:1.0:1736271770.876735:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fb97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058975168:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271770.876796:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fb97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058975168:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 63us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271770.876804:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 786 00000100:00080000:0.0:1736271771.110441:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271771.110447:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271771.110450:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271771.110455:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8551 00000100:00080000:0.0:1736271771.110458:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271771.110463:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271771.110476:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024090624:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271771.110479:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fb84c0 x1820604024090688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271771.110522:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271771.110524:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271771.110525:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271771.110527:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8551 00000100:00080000:0.0:1736271771.110528:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271771.110531:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271771.110536:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbb900 x1820604024090816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271771.110545:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271771.110547:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271771.110547:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271771.110549:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8551 00000100:00100000:2.0:1736271771.110550:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271771.110550:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024090688:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271771.110551:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271771.110552:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271771.110558:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074fbdf00 x1820604024090944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271771.110578:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271771.110580:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271771.110581:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271771.110582:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8551 00000100:00080000:0.0:1736271771.110584:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1736271771.110585:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024091072:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271771.110587:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271771.110591:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271771.110597:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131b13dc0 x1820604024091136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271771.110598:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbe880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024091008:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271771.110612:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024090816:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271771.110618:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271771.110641:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090688 00000100:00100000:2.0:1736271771.110647:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fb9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024090752:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271771.110647:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271771.110652:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271771.110665:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbdf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024090944:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271771.110674:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090816 00000100:00100000:2.0:1736271771.110677:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271771.110686:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271771.110691:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271771.110695:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090752 00000100:00100000:2.0:1736271771.110695:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074fbaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024090880:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271771.110697:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024091136:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271771.110706:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091072 00000100:00100000:2.0:1736271771.110711:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271771.110716:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1736271771.110720:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b281300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024090752:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271771.110727:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090944 00000100:00100000:2.0:1736271771.110740:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091008 00000100:00100000:1.0:1736271771.110749:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7066 00000100:00100000:3.0:1736271771.110751:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112810 00000100:00100000:1.0:1736271771.110755:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2804c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024091072:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271771.110755:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024090944:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271771.110762:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7067 00000100:00100000:0.0:1736271771.110763:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b281300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024090752:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271771.110766:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a8350c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024091008:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271771.110767:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00010000:02000000:3.0:1736271771.110769:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271771.110780:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090880 00000100:00100000:0.0:1736271771.110789:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:0.0:1736271771.110791:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b282140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024090880:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271771.110803:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a8350c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024091008:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271771.110804:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024090944:12345-0@lo:38:kworker/u8:2.0 Request processed in 49us (118us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271771.110808:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2804c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024091072:12345-0@lo:400:kworker/u8:2.0 Request processed in 53us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271771.110809:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7067 00000100:00100000:3.0:1736271771.110810:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112810 00000100:00100000:1.0:1736271771.110815:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7066 00000100:00100000:0.0:1736271771.110816:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b282140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024090880:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271771.110822:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1736271771.110825:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271771.110830:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091136 00000100:00100000:0.0:1736271771.110832:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1736271771.110835:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024090688:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271771.110840:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00010000:02000000:0.0:1736271771.110842:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736271771.110844:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271771.110845:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024090816:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271771.110846:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271771.110849:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1736271771.110849:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbdf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024090944:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271771.110853:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024091136:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271771.110856:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271771.110860:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024090688:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (270us total) trans 0 rc -19/-19 00010000:02000000:2.0:1736271771.110860:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736271771.110863:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271771.110865:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00080000:3.0:1736271771.110865:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271771.110867:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024090688:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271771.110887:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024090624 00000100:00100000:1.0:1736271771.110893:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024090816:12345-0@lo:38:kworker/u8:2.0 Request processed in 48us (246us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271771.110895:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024091136:12345-0@lo:38:kworker/u8:2.0 Request processed in 41us (69us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271771.110899:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1736271771.110902:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1736271771.110909:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1736271771.110913:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024090624:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271771.110928:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024090880:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271771.110937:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024090752:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271771.110941:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024090624:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271771.110946:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1736271771.110978:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbe880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024091008:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271771.110994:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271771.110995:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fb9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024091072:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271771.110996:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271771.110998:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024091136:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271771.111001:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024090624:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271771.111004:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271771.111005:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271771.111006:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074fbb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024090816:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271771.718489:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271772.720490:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271773.722495:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271774.724477:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271774.806470:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b15f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024091264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271774.806479:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2850c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024091200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271774.806528:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271774.806552:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271774.806586:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091200 00000100:00100000:0.0:1736271774.806624:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091264 00000100:00100000:1.0:1736271774.806632:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5866 00000100:00100000:1.0:1736271774.806638:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024091200:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271774.806649:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5867 00000100:00100000:0.0:1736271774.806653:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b284c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024091264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1736271774.806661:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:0.0:1736271774.806669:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736271774.806694:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024091200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271774.806702:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b284c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024091264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271774.806708:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5867 00000100:00100000:3.0:1736271774.806716:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b2850c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024091200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271774.806717:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b15f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024091264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271774.806722:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5866 00010000:00010000:2.0:1736271775.726494:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271775.884517:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271775.884565:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271775.884605:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975232 00000100:00100000:0.0:1736271775.884613:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271775.884647:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975360 00000100:00100000:0.0:1736271775.884662:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975296 00000100:00100000:2.0:1736271775.884666:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 272 00000100:00100000:2.0:1736271775.884672:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058975232:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271775.884681:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 789 00000100:00100000:1.0:1736271775.884685:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b15f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058975360:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271775.884689:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1054 00000100:00100000:0.0:1736271775.884695:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b13dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058975296:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271775.884711:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271775.884734:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b15f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058975360:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 48us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271775.884737:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058975232:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 65us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271775.884741:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 789 00000100:00100000:2.0:1736271775.884743:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 272 00000100:00100000:0.0:1736271775.884748:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b13dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058975296:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 54us (135us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271775.884753:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1054 00000100:00080000:0.0:1736271776.118401:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271776.118406:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271776.118408:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271776.118413:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8556 00000100:00080000:0.0:1736271776.118415:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271776.118418:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271776.118431:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a6ac2600 x1820604024091392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271776.118439:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6ac1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024091328:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271776.118448:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271776.118451:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271776.118451:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271776.118451:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6ac2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024091392:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271776.118453:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8556 00000100:00080000:0.0:1736271776.118454:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271776.118456:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271776.118461:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf597c0 x1820604024091520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271776.118492:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271776.118493:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271776.118494:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271776.118496:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271776.118497:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271776.118499:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8556 00000100:00080000:0.0:1736271776.118500:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271776.118502:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271776.118508:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b86a600 x1820604024091648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271776.118513:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736271776.118514:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf597c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024091520:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271776.118516:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf584c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024091456:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271776.118519:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271776.118520:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271776.118521:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271776.118522:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8556 00000100:00080000:0.0:1736271776.118523:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736271776.118525:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271776.118529:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b868000 x1820604024091840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271776.118529:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271776.118532:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b868980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024091712:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271776.118536:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024091584:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271776.118541:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024091648:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271776.118550:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271776.118552:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091392 00000100:00100000:3.0:1736271776.118557:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271776.118564:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271776.118569:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024091840:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271776.118574:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091520 00000100:00100000:2.0:1736271776.118576:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091328 00000100:00100000:0.0:1736271776.118581:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091584 00000100:00100000:3.0:1736271776.118582:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271776.118589:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091840 00000100:00100000:1.0:1736271776.118593:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091712 00000100:00100000:0.0:1736271776.118594:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:0.0:1736271776.118597:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a831c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024091584:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271776.118598:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1736271776.118602:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024091328:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271776.118602:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1736271776.118606:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024091392:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271776.118615:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271776.118616:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7068 00000100:00100000:1.0:1736271776.118619:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b283440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024091712:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271776.118628:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024091328:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271776.118634:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a831c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024091584:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271776.118635:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1736271776.118638:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1736271776.118648:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024091392:12345-0@lo:38:kworker/u8:2.0 Request processed in 42us (156us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271776.118651:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1736271776.118654:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024091520:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271776.118654:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00010000:02000000:0.0:1736271776.118658:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271776.118658:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b283440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024091712:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271776.118664:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7068 00000100:00100000:2.0:1736271776.118671:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b868980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024091712:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271776.118672:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1736271776.118673:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024091520:12345-0@lo:38:kworker/u8:2.0 Request processed in 19us (144us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271776.118676:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024091840:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271776.118678:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00010000:02000000:3.0:1736271776.118682:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271776.118688:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271776.118690:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024091584:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271776.118698:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091648 00000100:00100000:3.0:1736271776.118701:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024091840:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (119us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271776.118705:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6ac1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024091328:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271776.118706:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1736271776.118711:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112811 00000100:00100000:1.0:1736271776.118713:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091456 00000100:00100000:0.0:1736271776.118714:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2c3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024091648:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271776.118714:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024091776:0@lo:400:kworker/u8:2.0 00010000:02000000:0.0:1736271776.118720:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271776.118728:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00080000:3.0:1736271776.118730:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271776.118731:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b282600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024091456:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271776.118732:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271776.118733:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271776.118735:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024091840:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271776.118739:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2c3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024091648:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (181us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736271776.118742:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271776.118744:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112811 00000100:00080000:3.0:1736271776.118744:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271776.118746:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf597c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024091520:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271776.118752:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271776.118753:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271776.118755:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b282600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024091456:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (67us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271776.118755:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024091648:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271776.118760:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf584c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024091456:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271776.118761:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00080000:3.0:1736271776.118761:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271776.118763:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271776.118765:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6ac2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024091392:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271776.118774:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091776 00000100:00100000:1.0:1736271776.118802:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7069 00000100:00100000:1.0:1736271776.118810:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b284740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024091776:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271776.118842:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b284740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024091776:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271776.118847:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7069 00000100:00100000:2.0:1736271776.118869:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024091776:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271776.728440:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271777.730481:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271778.732453:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271779.734444:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271779.814456:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736271779.814457:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271779.814473:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8697c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024091968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271779.814473:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2876c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024091904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271779.814531:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271779.814554:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091968 00000100:00100000:3.0:1736271779.814568:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271779.814584:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024091904 00000100:00100000:0.0:1736271779.814590:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5868 00000100:00100000:0.0:1736271779.814595:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b868e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024091968:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271779.814600:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5869 00000100:00100000:2.0:1736271779.814604:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbb900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024091904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271779.814618:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271779.814619:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271779.814648:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbb900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024091904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271779.814654:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5869 00000100:00100000:0.0:1736271779.814662:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b868e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024091968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271779.814667:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5868 00000100:00100000:3.0:1736271779.814668:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b2876c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024091904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271779.814693:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b8697c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024091968:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271780.736450:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271780.892519:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271780.892550:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271780.892576:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271780.892588:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975424 00000100:00100000:0.0:1736271780.892601:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975552 00000100:00100000:0.0:1736271780.892620:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975488 00000100:00100000:2.0:1736271780.892636:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 274 00000100:00100000:1.0:1736271780.892637:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 792 00000100:00100000:0.0:1736271780.892642:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1058 00000100:00100000:1.0:1736271780.892642:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b86c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058975552:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271780.892642:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058975424:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271780.892645:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b86c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058975488:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271780.892654:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271780.892690:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b86c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058975552:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 48us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271780.892691:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b86c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058975488:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 45us (115us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271780.892692:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058975424:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271780.892695:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1058 00000100:00100000:1.0:1736271780.892698:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 792 00000100:00100000:2.0:1736271780.892699:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 274 00000100:00080000:0.0:1736271781.126442:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271781.126446:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271781.126449:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271781.126453:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8561 00000100:00080000:0.0:1736271781.126456:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271781.126459:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271781.126473:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b86a140 x1820604024092096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271781.126488:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1736271781.126501:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271781.126504:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271781.126505:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271781.126508:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8561 00000100:00080000:0.0:1736271781.126509:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00100000:2.0:1736271781.126509:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b869300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024092032:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271781.126512:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271781.126522:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b86b900 x1820604024092224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271781.126535:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271781.126537:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271781.126538:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271781.126539:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024092160:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271781.126552:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8561 00000100:00080000:0.0:1736271781.126554:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271781.126557:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271781.126567:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b86aac0 x1820604024092352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271781.126571:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271781.126576:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271781.126584:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271781.126587:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271781.126588:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271781.126590:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8561 00000100:00080000:0.0:1736271781.126592:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736271781.126594:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271781.126595:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024092416:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271781.126595:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271781.126601:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b86af80 x1820604024092544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271781.126607:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8697c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024092288:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271781.126616:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271781.126621:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024092480:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271781.126629:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271781.126643:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092416 00000100:00100000:2.0:1736271781.126643:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092032 00000100:00100000:3.0:1736271781.126650:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024092096:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271781.126653:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271781.126668:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271781.126672:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092480 00000100:00100000:2.0:1736271781.126673:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1736271781.126677:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024092224:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271781.126678:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024092032:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271781.126683:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7070 00000100:00100000:1.0:1736271781.126687:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b280980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024092416:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271781.126688:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7071 00000100:00100000:3.0:1736271781.126690:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271781.126692:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d5fb440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024092480:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271781.126698:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024092352:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271781.126716:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024092032:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271781.126718:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271781.126720:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b280980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024092416:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271781.126722:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1736271781.126726:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7070 00000100:00100000:0.0:1736271781.126733:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d5fb440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024092480:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271781.126737:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024092544:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271781.126739:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7071 00000100:00100000:0.0:1736271781.126756:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092160 00000100:00100000:1.0:1736271781.126756:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024092480:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271781.126756:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271781.126757:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024092416:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271781.126764:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b869300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024092032:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271781.126771:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092288 00000100:00100000:1.0:1736271781.126776:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092096 00000100:00100000:0.0:1736271781.126778:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092224 00000100:00100000:3.0:1736271781.126780:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092544 00000100:00100000:0.0:1736271781.126785:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:0.0:1736271781.126787:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024092160:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271781.126793:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1736271781.126795:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fb9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024092288:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271781.126800:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1736271781.126803:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1736271781.126804:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbe880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024092096:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271781.126806:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fb9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024092224:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271781.126811:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024092160:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271781.126813:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fb9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024092288:12345-0@lo:400:kworker/u8:2.0 Request processed in 18us (185us total) trans 0 rc 0/0 00010000:02000000:2.0:1736271781.126813:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736271781.126813:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271781.126821:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:1.0:1736271781.126823:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:0.0:1736271781.126831:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1736271781.126833:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fb84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024092544:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271781.126839:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271781.126842:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092352 00000100:00100000:3.0:1736271781.126842:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fb9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024092224:12345-0@lo:38:kworker/u8:2.0 Request processed in 36us (152us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271781.126843:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbe880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024092096:12345-0@lo:38:kworker/u8:2.0 Request processed in 39us (175us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271781.126846:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1736271781.126848:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1736271781.126857:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fb84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024092544:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (101us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271781.126858:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112812 00000100:00100000:0.0:1736271781.126861:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:1.0:1736271781.126861:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbaac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024092352:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271781.126863:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b8697c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024092288:0@lo:400:kworker/u8:2.0 00010000:02000000:1.0:1736271781.126867:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271781.126869:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024092160:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271781.126880:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271781.126882:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271781.126883:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024092096:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271781.126905:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbaac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024092352:12345-0@lo:38:kworker/u8:2.0 Request processed in 43us (185us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271781.126910:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112812 00000100:00080000:3.0:1736271781.126912:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271781.126913:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271781.126919:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024092224:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271781.126925:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271781.126926:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271781.126928:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024092352:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271781.126932:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271781.126933:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271781.126934:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024092544:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271781.738428:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271782.740434:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271783.742451:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271784.744469:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271784.822455:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b868980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024092608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271784.822455:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b285580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024092672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271784.822514:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271784.822546:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271784.822564:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092672 00000100:00100000:3.0:1736271784.822575:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092608 00000100:00100000:2.0:1736271784.822600:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5870 00000100:00100000:2.0:1736271784.822604:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074fbdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024092672:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271784.822604:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5871 00000100:00100000:3.0:1736271784.822607:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d5fe3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024092608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271784.822622:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:3.0:1736271784.822624:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271784.822650:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074fbdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024092672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271784.822654:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5870 00000100:00100000:3.0:1736271784.822662:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d5fe3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024092608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271784.822669:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5871 00000100:00100000:0.0:1736271784.822670:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b285580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024092672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271784.822689:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b868980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024092608:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271785.746457:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271785.900500:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271785.900544:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271785.900576:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975616 00000100:00100000:0.0:1736271785.900577:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271785.900597:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975744 00000100:00100000:1.0:1736271785.900611:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975680 00000100:00100000:0.0:1736271785.900620:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 795 00000100:00100000:2.0:1736271785.900620:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 276 00000100:00100000:2.0:1736271785.900624:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058975616:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271785.900625:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b868980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058975744:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271785.900636:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1062 00000100:00100000:1.0:1736271785.900640:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b86af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058975680:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271785.900651:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271785.900681:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058975616:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 57us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271785.900682:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b868980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058975744:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271785.900689:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 795 00000100:00100000:1.0:1736271785.900689:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b86af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058975680:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 48us (110us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271785.900689:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 276 00000100:00100000:1.0:1736271785.900695:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1062 00000100:00080000:0.0:1736271786.134414:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271786.134421:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271786.134423:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271786.134429:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8566 00000100:00080000:0.0:1736271786.134433:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271786.134438:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271786.134447:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024092736:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271786.134455:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b86b900 x1820604024092800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271786.134500:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271786.134502:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271786.134503:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271786.134505:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8566 00000100:00080000:0.0:1736271786.134507:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271786.134509:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271786.134515:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b86bdc0 x1820604024092928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271786.134519:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271786.134523:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024092864:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271786.134531:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271786.134534:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271786.134535:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271786.134536:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024092800:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271786.134537:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8566 00000100:00080000:0.0:1736271786.134539:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271786.134542:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271786.134555:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b869300 x1820604024093056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271786.134559:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271786.134568:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092736 00000100:00100000:3.0:1736271786.134583:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736271786.134591:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8697c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024092992:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271786.134599:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1736271786.134603:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024092736:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271786.134606:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1736271786.134607:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271786.134610:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271786.134611:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271786.134613:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024093120:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271786.134613:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271786.134614:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8566 00000100:00080000:0.0:1736271786.134615:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736271786.134618:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271786.134626:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013733df00 x1820604024093248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271786.134634:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271786.134643:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024092736:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271786.134643:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092864 00000100:00100000:0.0:1736271786.134646:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092992 00000100:00100000:2.0:1736271786.134649:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1736271786.134653:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736271786.134657:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024093184:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271786.134667:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:1.0:1736271786.134669:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271786.134671:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1736271786.134671:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d5fe880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024092864:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271786.134674:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013715cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024092992:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271786.134681:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093120 00000100:00100000:2.0:1736271786.134686:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024092736:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271786.134696:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093184 00000100:00100000:1.0:1736271786.134705:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7072 00000100:00100000:1.0:1736271786.134707:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d5fa140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024093120:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271786.134710:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013715cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024092992:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271786.134715:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1736271786.134716:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d5fe880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024092864:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271786.134722:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:2.0:1736271786.134724:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7073 00000100:00100000:1.0:1736271786.134725:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d5fa140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024093120:12345-0@lo:400:kworker/u8:2.0 Request processed in 16us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271786.134729:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7072 00000100:00100000:2.0:1736271786.134729:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb10e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024093184:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271786.134746:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024093120:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271786.134747:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b8697c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024092992:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271786.134752:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb10e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024093184:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271786.134755:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7073 00000100:00100000:1.0:1736271786.134757:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024093184:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271786.134762:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024092864:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271786.134762:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271786.134772:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024092928:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271786.134789:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271786.134810:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b869300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024093056:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271786.134827:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092800 00000100:00100000:3.0:1736271786.134827:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271786.134837:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013733df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024093248:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271786.134840:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093056 00000100:00100000:0.0:1736271786.134841:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024092928 00000100:00100000:1.0:1736271786.134865:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112813 00000100:00100000:1.0:1736271786.134868:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007054af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024093056:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271786.134868:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:1.0:1736271786.134877:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271786.134884:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093248 00000100:00100000:2.0:1736271786.134890:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:2.0:1736271786.134894:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013715da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024092800:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271786.134896:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007054af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024093056:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (69us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271786.134899:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:1.0:1736271786.134899:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112813 00010000:02000000:2.0:1736271786.134901:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271786.134902:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007054f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024092928:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271786.134903:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1736271786.134907:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007054c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024093248:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271786.134908:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736271786.134914:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271786.134932:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013715da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024092800:12345-0@lo:38:kworker/u8:2.0 Request processed in 38us (170us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271786.134938:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007054f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024092928:12345-0@lo:38:kworker/u8:2.0 Request processed in 36us (149us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271786.134938:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:3.0:1736271786.134942:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007054c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024093248:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (89us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271786.134943:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1736271786.134947:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00080000:3.0:1736271786.134968:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271786.134970:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271786.134973:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b869300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024093056:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271786.134979:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271786.134981:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271786.134983:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013733df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024093248:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271786.134989:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271786.134996:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271786.134998:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024092800:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271786.135006:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271786.135008:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271786.135010:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024092928:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271786.748406:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271787.750450:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271788.752612:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271789.754467:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271789.830441:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024093376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271789.830446:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013733cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024093312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271789.830504:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271789.830535:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093376 00000100:00100000:3.0:1736271789.830542:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271789.830584:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093312 00000100:00100000:3.0:1736271789.830588:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5872 00000100:00100000:3.0:1736271789.830593:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024093376:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271789.830610:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5873 00000100:00100000:2.0:1736271789.830614:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007054a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024093312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1736271789.830623:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271789.830630:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271789.830657:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007054a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024093312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271789.830662:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5873 00000100:00100000:3.0:1736271789.830665:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024093376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271789.830671:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5872 00000100:00100000:0.0:1736271789.830683:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013733cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024093312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271789.830689:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024093376:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271790.756454:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271790.908469:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271790.908498:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271790.908528:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271790.908585:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975936 00000100:00100000:3.0:1736271790.908585:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975872 00000100:00100000:2.0:1736271790.908586:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058975808 00000100:00100000:2.0:1736271790.908624:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 278 00000100:00100000:2.0:1736271790.908629:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058975808:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271790.908631:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 798 00000100:00100000:1.0:1736271790.908635:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1066 00000100:00100000:3.0:1736271790.908635:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058975936:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271790.908638:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058975872:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271790.908650:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271790.908689:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058975808:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 60us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271790.908689:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058975936:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 53us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271790.908690:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058975872:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 51us (161us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271790.908695:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1066 00000100:00100000:2.0:1736271790.908696:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 278 00000100:00100000:3.0:1736271790.908703:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 798 00000100:00080000:0.0:1736271791.142415:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271791.142420:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271791.142423:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271791.142427:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8571 00000100:00080000:0.0:1736271791.142430:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271791.142434:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271791.142449:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013733d0c0 x1820604024093504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271791.142461:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013733da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024093440:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271791.142491:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271791.142499:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1736271791.142504:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271791.142505:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736271791.142507:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013733d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024093504:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271791.142508:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8571 00000100:00080000:0.0:1736271791.142510:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271791.142513:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271791.142520:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013733df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024093568:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271791.142522:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271791.142523:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008fb92f80 x1820604024093632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271791.142535:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271791.142538:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271791.142538:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736271791.142540:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271791.142541:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8571 00000100:00080000:0.0:1736271791.142542:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271791.142544:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271791.142550:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008fb97200 x1820604024093760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271791.142556:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb92f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024093632:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271791.142565:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093504 00000100:00080000:0.0:1736271791.142572:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736271791.142572:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271791.142574:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271791.142575:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271791.142577:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8571 00000100:00080000:0.0:1736271791.142578:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271791.142579:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271791.142584:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008fb96d40 x1820604024093952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271791.142587:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093632 00000100:00100000:1.0:1736271791.142588:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024093824:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271791.142588:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb97200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024093760:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271791.142596:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736271791.142598:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1736271791.142601:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271791.142602:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb95f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024093696:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271791.142603:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b286d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024093504:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271791.142611:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb96d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024093952:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271791.142618:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1736271791.142619:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271791.142621:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271791.142632:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093952 00000100:00100000:2.0:1736271791.142645:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093440 00000100:00100000:0.0:1736271791.142646:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1736271791.142646:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271791.142648:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b285580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024093632:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271791.142651:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb963c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024093888:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271791.142651:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b286d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024093504:12345-0@lo:38:kworker/u8:2.0 Request processed in 47us (110us total) trans 0 rc -19/-19 00010000:02000000:0.0:1736271791.142653:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271791.142657:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1736271791.142667:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1736271791.142669:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024093440:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271791.142669:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1736271791.142672:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2850c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024093952:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271791.142674:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b285580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024093632:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (102us total) trans 0 rc -19/-19 00010000:02000000:3.0:1736271791.142677:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271791.142678:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1736271791.142684:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271791.142693:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271791.142693:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024093440:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271791.142695:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2850c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024093952:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (73us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271791.142696:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1736271791.142700:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1736271791.142707:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093696 00000100:00100000:2.0:1736271791.142715:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093760 00000100:00100000:0.0:1736271791.142721:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1736271791.142722:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093824 00000100:00100000:0.0:1736271791.142723:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb92600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024093696:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271791.142725:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112814 00000100:00100000:2.0:1736271791.142727:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2876c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024093760:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271791.142729:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013733da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024093440:0@lo:400:kworker/u8:2.0 00010000:02000000:2.0:1736271791.142731:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271791.142740:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb92600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024093696:12345-0@lo:400:kworker/u8:2.0 Request processed in 16us (46us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271791.142743:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:2.0:1736271791.142743:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2876c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024093760:12345-0@lo:38:kworker/u8:2.0 Request processed in 15us (142us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271791.142746:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112814 00000100:00100000:1.0:1736271791.142752:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093888 00000100:00080000:2.0:1736271791.142763:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271791.142765:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271791.142766:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7074 00000100:00100000:2.0:1736271791.142767:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb96d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024093952:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271791.142770:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb12600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024093824:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271791.142771:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb95f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024093696:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271791.142771:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271791.142772:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271791.142773:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb97200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024093760:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271791.142776:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7075 00000100:00080000:2.0:1736271791.142777:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271791.142778:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271791.142779:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb92f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024093632:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271791.142781:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb11300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024093888:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271791.142783:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271791.142784:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271791.142785:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013733d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024093504:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271791.142816:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb12600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024093824:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271791.142817:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb11300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024093888:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271791.142839:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7074 00000100:00100000:0.0:1736271791.142844:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb963c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024093888:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271791.142844:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7075 00000100:00100000:0.0:1736271791.142853:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024093824:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271791.142864:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271791.142887:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024093568 00000100:00100000:0.0:1736271791.142911:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:0.0:1736271791.142915:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024093568:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271791.142952:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024093568:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271791.142957:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1736271791.142986:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013733df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024093568:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271791.758449:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271792.760446:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271793.762460:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271794.764491:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271794.838432:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024094016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271794.838432:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b575580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024094080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271794.838484:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271794.838511:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271794.838517:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094016 00000100:00100000:2.0:1736271794.838558:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094080 00000100:00100000:2.0:1736271794.838578:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5874 00000100:00100000:2.0:1736271794.838583:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb963c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024094016:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271794.838583:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5875 00000100:00100000:3.0:1736271794.838586:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b575a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024094080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271794.838605:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:3.0:1736271794.838605:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271794.838637:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb963c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024094016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271794.838637:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b575a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024094080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271794.838642:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5874 00000100:00100000:3.0:1736271794.838644:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5875 00000100:00100000:0.0:1736271794.838656:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024094016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271794.838656:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b575580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024094080:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271795.766460:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271795.916678:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271795.916727:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271795.916770:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976000 00000100:00100000:0.0:1736271795.916848:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271795.916860:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 280 00000100:00100000:2.0:1736271795.916866:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058976000:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271795.916885:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976128 00000100:00100000:3.0:1736271795.916911:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976064 00000100:00100000:1.0:1736271795.916939:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 801 00000100:00100000:1.0:1736271795.916945:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058976128:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271795.916945:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1070 00000100:00100000:3.0:1736271795.916950:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb95f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058976064:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736271795.916972:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271795.917001:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb95f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058976064:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 50us (154us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271795.917002:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058976128:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 55us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271795.917003:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058976000:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 134us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271795.917008:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1070 00000100:00100000:1.0:1736271795.917012:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 801 00000100:00100000:2.0:1736271795.917012:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 280 00000100:00080000:0.0:1736271796.150477:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271796.150484:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271796.150488:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271796.150495:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8576 00000100:00080000:0.0:1736271796.150501:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271796.150507:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271796.150529:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008fb950c0 x1820604024094208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271796.150537:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb93dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024094144:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271796.150559:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271796.150562:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271796.150564:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271796.150567:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8576 00000100:00080000:0.0:1736271796.150569:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271796.150572:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271796.150578:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb90e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024094272:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271796.150582:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008fb92f80 x1820604024094336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271796.150610:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271796.150611:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271796.150614:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271796.150615:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271796.150618:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8576 00000100:00080000:0.0:1736271796.150632:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271796.150636:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271796.150644:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271796.150646:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008fb96d40 x1820604024094464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271796.150660:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb950c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024094208:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271796.150662:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb97200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024094400:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271796.150670:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271796.150672:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1736271796.150674:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271796.150675:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271796.150677:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8576 00000100:00100000:3.0:1736271796.150678:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024094592:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271796.150679:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271796.150682:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271796.150684:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271796.150691:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800897c7200 x1820604024094656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271796.150697:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024094528:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271796.150704:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb92f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024094336:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271796.150707:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271796.150735:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094592 00000100:00100000:2.0:1736271796.150737:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271796.150752:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb96d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024094464:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271796.150755:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094272 00000100:00100000:3.0:1736271796.150758:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094208 00000100:00100000:1.0:1736271796.150768:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7076 00000100:00100000:2.0:1736271796.150771:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271796.150773:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024094592:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271796.150780:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094336 00000100:00100000:0.0:1736271796.150803:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:2.0:1736271796.150804:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024094656:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271796.150809:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880070548e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024094272:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271796.150817:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:3.0:1736271796.150820:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b283900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024094208:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271796.150833:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271796.150834:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271796.150839:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024094592:12345-0@lo:400:kworker/u8:2.0 Request processed in 66us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271796.150845:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7076 00000100:00100000:0.0:1736271796.150856:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880070548e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024094272:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271796.150859:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094144 00000100:00100000:0.0:1736271796.150862:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1736271796.150869:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271796.150872:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b283900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024094208:12345-0@lo:38:kworker/u8:2.0 Request processed in 51us (187us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271796.150878:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1736271796.150883:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1736271796.150887:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024094144:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271796.150889:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094656 00000100:00100000:1.0:1736271796.150892:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094528 00000100:00100000:0.0:1736271796.150897:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:3.0:1736271796.150900:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1736271796.150901:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b86bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024094336:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271796.150903:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b869300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024094656:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271796.150906:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7077 00010000:02000000:0.0:1736271796.150907:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736271796.150908:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271796.150910:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b575580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024094528:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271796.150928:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024094144:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271796.150933:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1736271796.150935:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b86bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024094336:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (199us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271796.150938:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b869300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024094656:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (104us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271796.150942:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:1.0:1736271796.150942:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b575580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024094528:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271796.150948:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7077 00000100:00100000:3.0:1736271796.150949:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1736271796.150962:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094464 00000100:00080000:2.0:1736271796.150966:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271796.150969:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271796.150973:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024094656:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271796.150978:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112815 00000100:00080000:2.0:1736271796.150983:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271796.150985:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271796.150987:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b86b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024094464:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271796.150988:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb950c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024094208:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271796.150988:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024094592:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271796.150991:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024094528:0@lo:400:kworker/u8:2.0 00010000:02000000:0.0:1736271796.150994:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1736271796.150996:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271796.150998:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271796.150999:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb90e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024094272:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271796.151000:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb92f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024094336:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271796.151008:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271796.151015:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b86b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024094464:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (243us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271796.151020:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112815 00000100:00080000:2.0:1736271796.151025:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271796.151027:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271796.151030:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb96d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024094464:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271796.151037:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094400 00000100:00100000:3.0:1736271796.151059:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:3.0:1736271796.151062:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b576d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024094400:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271796.151069:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb93dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024094144:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271796.151100:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b576d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024094400:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271796.151106:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1736271796.151112:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb97200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024094400:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271796.768476:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271797.770457:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271798.772440:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271799.774439:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271799.846416:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736271799.846421:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024094784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271799.846430:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024094720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271799.846478:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271799.846527:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094720 00000100:00100000:1.0:1736271799.846530:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271799.846557:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094784 00000100:00100000:1.0:1736271799.846567:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5876 00000100:00100000:2.0:1736271799.846572:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5877 00000100:00100000:1.0:1736271799.846573:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024094720:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271799.846576:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024094784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736271799.846598:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271799.846602:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:1.0:1736271799.846627:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024094720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271799.846633:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5876 00000100:00100000:2.0:1736271799.846634:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024094784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271799.846640:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5877 00000100:00100000:0.0:1736271799.846656:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b5717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024094720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271799.846664:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024094784:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271800.776471:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271800.925118:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271800.925161:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271800.925194:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271800.925243:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976192 00000100:00100000:1.0:1736271800.925300:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976256 00000100:00100000:2.0:1736271800.925320:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 282 00000100:00100000:2.0:1736271800.925325:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058976192:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271800.925332:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1074 00000100:00100000:1.0:1736271800.925336:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058976256:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271800.925349:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271800.925351:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976320 00000100:00100000:1.0:1736271800.925391:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058976256:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 54us (229us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271800.925392:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 804 00000100:00100000:2.0:1736271800.925394:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058976192:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 68us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271800.925397:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058976320:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271800.925398:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1074 00000100:00100000:2.0:1736271800.925401:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 282 00000100:00100000:3.0:1736271800.925439:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058976320:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 43us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271800.925444:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 804 00000100:00080000:0.0:1736271801.158460:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271801.158465:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271801.158468:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271801.158473:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8581 00000100:00080000:0.0:1736271801.158476:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271801.158482:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271801.158500:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800897c17c0 x1820604024094912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271801.158506:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024094848:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271801.158529:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271801.158531:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271801.158532:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271801.158534:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8581 00000100:00100000:1.0:1736271801.158534:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024094976:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271801.158535:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271801.158550:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271801.158550:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024094912:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271801.158557:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800897c7200 x1820604024095040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271801.158566:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271801.158567:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271801.158569:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271801.158570:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271801.158570:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271801.158572:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8581 00000100:00080000:0.0:1736271801.158573:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271801.158575:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271801.158582:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008f123440 x1820604024095168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271801.158593:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1736271801.158596:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271801.158597:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024095104:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271801.158598:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1736271801.158598:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008f125580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024095296:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271801.158599:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271801.158601:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8581 00000100:00080000:0.0:1736271801.158602:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736271801.158603:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271801.158608:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008f122f80 x1820604024095360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271801.158613:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271801.158614:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271801.158631:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008f126d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024095232:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271801.158635:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094976 00000100:00100000:1.0:1736271801.158635:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095296 00000100:00100000:2.0:1736271801.158641:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271801.158648:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094848 00000100:00100000:0.0:1736271801.158662:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095104 00000100:00100000:1.0:1736271801.158664:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095232 00000100:00100000:2.0:1736271801.158668:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:2.0:1736271801.158672:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b576880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024094976:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271801.158676:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1736271801.158679:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:1.0:1736271801.158679:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7078 00000100:00100000:3.0:1736271801.158680:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024094848:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271801.158684:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024095104:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271801.158684:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024095296:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271801.158711:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b576880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024094976:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271801.158716:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:3.0:1736271801.158716:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024094848:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271801.158720:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1736271801.158723:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024095296:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271801.158729:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7078 00000100:00100000:0.0:1736271801.158731:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024095104:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271801.158737:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:1.0:1736271801.158742:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7079 00000100:00100000:3.0:1736271801.158743:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271801.158744:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024094976:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271801.158745:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8697c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024095232:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271801.158770:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024095040:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271801.158772:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024094912 00000100:00100000:0.0:1736271801.158785:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1736271801.158788:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013733da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024094912:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271801.158791:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8697c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024095232:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271801.158795:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271801.158797:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7079 00000100:00100000:2.0:1736271801.158799:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008f125580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024095296:0@lo:400:kworker/u8:2.0 00010000:02000000:0.0:1736271801.158800:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271801.158804:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008f123440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024095168:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271801.158805:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008f126d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024095232:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271801.158809:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024094848:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271801.158818:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271801.158826:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013733da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024094912:12345-0@lo:38:kworker/u8:2.0 Request processed in 37us (82us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271801.158827:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008f122f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024095360:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271801.158828:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095040 00000100:00100000:0.0:1736271801.158832:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1736271801.158832:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095168 00000100:00100000:3.0:1736271801.158837:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271801.158839:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095360 00000100:00100000:0.0:1736271801.158842:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:0.0:1736271801.158845:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998de880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024095040:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271801.158846:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112816 00000100:00100000:2.0:1736271801.158847:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00080000:3.0:1736271801.158847:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271801.158848:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271801.158849:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998d9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024095168:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271801.158849:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998daf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024095360:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271801.158850:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271801.158850:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024094912:0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271801.158854:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736271801.158855:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271801.158872:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998de880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024095040:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (76us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736271801.158872:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271801.158873:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271801.158875:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024095040:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271801.158876:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1736271801.158878:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998d9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024095168:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (59us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271801.158878:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998daf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024095360:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (40us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736271801.158879:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271801.158880:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271801.158881:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112816 00000100:00100000:3.0:1736271801.158881:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008f123440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024095168:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271801.158884:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00080000:3.0:1736271801.158885:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271801.158886:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271801.158888:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008f122f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024095360:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271801.158898:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024095104:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271801.778445:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271802.780463:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271803.782460:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271804.784435:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271804.854434:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024095488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271804.854458:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008f122140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024095424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271804.854492:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271804.854528:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095488 00000100:00100000:3.0:1736271804.854533:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271804.854554:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095424 00000100:00100000:2.0:1736271804.854563:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5878 00000100:00100000:2.0:1736271804.854566:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024095488:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271804.854568:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5879 00000100:00100000:3.0:1736271804.854571:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998dbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024095424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271804.854586:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:3.0:1736271804.854586:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736271804.854616:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998dbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024095424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271804.854620:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5879 00000100:00100000:2.0:1736271804.854625:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024095488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271804.854631:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5878 00000100:00100000:3.0:1736271804.854649:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008f122140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024095424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271804.854655:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024095488:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271805.786429:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271805.932518:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271805.932554:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271805.932598:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976512 00000100:00100000:0.0:1736271805.932609:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271805.932618:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976448 00000100:00100000:2.0:1736271805.932642:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 807 00000100:00100000:0.0:1736271805.932643:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976384 00000100:00100000:2.0:1736271805.932647:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f121c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058976512:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271805.932653:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1078 00000100:00100000:3.0:1736271805.932656:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1276c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058976448:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:0.0:1736271805.932662:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 284 00000100:00100000:0.0:1736271805.932665:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058976384:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00010000:02000000:3.0:1736271805.932667:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271805.932697:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058976384:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 31us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271805.932701:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f121c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058976512:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 53us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271805.932702:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 284 00000100:00100000:2.0:1736271805.932718:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 807 00000100:00100000:3.0:1736271805.936448:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1276c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058976448:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 3789us (3893us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271805.936453:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1078 00000100:00080000:2.0:1736271806.166390:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271806.166397:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271806.166399:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271806.166405:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8586 00000100:00080000:2.0:1736271806.166408:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271806.166412:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271806.166424:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736271806.166430:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b86a600 x1820604024095616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271806.166440:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024095552:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271806.166468:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271806.166471:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271806.166472:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271806.166475:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8586 00000100:00080000:2.0:1736271806.166477:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271806.166480:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271806.166487:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024095616:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271806.166489:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800897c76c0 x1820604024095744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271806.166490:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271806.166500:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024095680:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271806.166503:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271806.166514:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271806.166516:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271806.166517:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271806.166520:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8586 00000100:00080000:2.0:1736271806.166521:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00100000:0.0:1736271806.166522:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271806.166524:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271806.166531:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024095808:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271806.166535:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800897c17c0 x1820604024095872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271806.166546:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271806.166556:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024095744:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271806.166560:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271806.166565:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271806.166568:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024095936:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271806.166568:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271806.166569:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271806.166572:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8586 00000100:00080000:2.0:1736271806.166574:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00100000:0.0:1736271806.166576:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271806.166577:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271806.166581:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736271806.166586:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008fb97200 x1820604024096064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271806.166586:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024096000:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271806.166590:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024095872:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271806.166591:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271806.166605:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271806.166608:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271806.166614:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095616 00000100:00100000:1.0:1736271806.166617:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095680 00000100:00100000:0.0:1736271806.166621:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb97200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024096064:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271806.166625:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095936 00000100:00100000:0.0:1736271806.166635:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271806.166644:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096000 00000100:00100000:1.0:1736271806.166646:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095744 00000100:00100000:2.0:1736271806.166646:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095808 00000100:00100000:1.0:1736271806.166651:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096064 00000100:00100000:1.0:1736271806.166657:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1736271806.166658:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7080 00000100:00100000:0.0:1736271806.166661:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095552 00000100:00100000:1.0:1736271806.166661:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b574c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024095680:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271806.166661:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1736271806.166662:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024095936:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271806.166664:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998df200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024095808:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271806.166681:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1736271806.166684:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024095552:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271806.166689:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b574c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024095680:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271806.166693:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:2.0:1736271806.166697:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998df200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024095808:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271806.166699:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024095936:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271806.166701:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:1.0:1736271806.166704:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:3.0:1736271806.166705:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7080 00000100:00100000:1.0:1736271806.166706:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f121300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024095616:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271806.166708:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1736271806.166710:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024095552:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271806.166710:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f124740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024095744:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271806.166715:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00010000:02000000:1.0:1736271806.166715:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736271806.166715:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271806.166741:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7081 00000100:00100000:3.0:1736271806.166744:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998da600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024096000:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271806.166751:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f124740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024095744:12345-0@lo:38:kworker/u8:2.0 Request processed in 39us (174us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271806.166754:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1736271806.166758:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1736271806.166761:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f127200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024096064:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271806.166768:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998da600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024096000:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (163us total) trans 0 rc 0/0 00010000:02000000:0.0:1736271806.166769:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271806.166769:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f121300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024095616:12345-0@lo:38:kworker/u8:2.0 Request processed in 61us (247us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271806.166772:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7081 00000100:00100000:1.0:1736271806.166775:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1736271806.166775:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024095808:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271806.166788:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f127200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024096064:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (153us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271806.166793:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00080000:2.0:1736271806.166794:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736271806.166794:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024095936:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271806.166795:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271806.166796:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024095872 00000100:00100000:2.0:1736271806.166797:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb97200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024096064:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271806.166807:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271806.166808:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271806.166809:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112817 00000100:00100000:2.0:1736271806.166810:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024095744:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271806.166811:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f126880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024095872:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271806.166814:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271806.166815:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00010000:02000000:1.0:1736271806.166816:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271806.166816:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024095616:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271806.166818:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024096000:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271806.166825:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024095552:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271806.166838:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f126880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024095872:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (229us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271806.166842:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112817 00000100:00080000:2.0:1736271806.166847:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271806.166848:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271806.166850:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024095872:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271806.166863:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024095680:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271806.788449:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271807.790433:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271808.792468:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271809.794433:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271809.862394:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271809.862408:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b577200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024096128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271809.862432:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736271809.862441:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008f122140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024096192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271809.862466:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271809.862497:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271809.862507:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096128 00000100:00100000:1.0:1736271809.862521:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096192 00000100:00100000:2.0:1736271809.862540:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5880 00000100:00100000:2.0:1736271809.862543:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5717c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024096128:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271809.862546:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5881 00000100:00100000:1.0:1736271809.862549:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998d9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024096192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271809.862561:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:1.0:1736271809.862563:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736271809.862587:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998d9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024096192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271809.862587:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5717c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024096128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271809.862591:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5880 00000100:00100000:1.0:1736271809.862593:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5881 00000100:00100000:0.0:1736271809.862606:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b577200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024096128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271809.862612:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008f122140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024096192:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271810.796458:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271810.940552:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271810.940596:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271810.940621:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976576 00000100:00100000:0.0:1736271810.940628:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271810.940652:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976640 00000100:00100000:0.0:1736271810.940658:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976704 00000100:00100000:2.0:1736271810.940661:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 286 00000100:00100000:2.0:1736271810.940667:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058976576:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271810.940712:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 810 00000100:00100000:0.0:1736271810.940718:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1082 00000100:00100000:1.0:1736271810.940718:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f123440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058976704:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271810.940721:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f122f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058976640:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271810.940733:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271810.940736:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058976576:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 69us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271810.940747:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 286 00000100:00100000:1.0:1736271810.940749:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f123440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058976704:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 31us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271810.940755:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f122f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058976640:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 34us (160us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271810.940755:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 810 00000100:00100000:0.0:1736271810.940759:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1082 00000100:00080000:2.0:1736271811.174408:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271811.174413:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271811.174416:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271811.174421:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8591 00000100:00080000:2.0:1736271811.174424:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271811.174428:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271811.174443:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008fb93dc0 x1820604024096320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271811.174447:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb97200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024096256:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271811.174465:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb93dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024096320:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271811.174475:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271811.174478:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271811.174479:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271811.174482:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8591 00000100:00080000:2.0:1736271811.174483:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271811.174487:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271811.174498:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008fb90e40 x1820604024096448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271811.174507:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271811.174508:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271811.174510:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271811.174512:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271811.174513:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271811.174515:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8591 00000100:00080000:2.0:1736271811.174517:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271811.174519:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271811.174527:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008fb950c0 x1820604024096576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271811.174531:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb96d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024096384:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271811.174532:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb90e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024096448:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271811.174540:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb92f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024096512:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271811.174547:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271811.174559:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb950c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024096576:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271811.174560:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271811.174561:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271811.174563:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271811.174564:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271811.174567:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8591 00000100:00100000:3.0:1736271811.174567:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024096704:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271811.174569:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271811.174571:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271811.174575:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271811.174578:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b86a600 x1820604024096768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271811.174585:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271811.174586:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024096768:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271811.174598:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736271811.174600:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096320 00000100:00100000:2.0:1736271811.174600:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096256 00000100:00100000:3.0:1736271811.174603:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024096640:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271811.174607:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271811.174618:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271811.174622:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096448 00000100:00100000:2.0:1736271811.174623:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1736271811.174627:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024096256:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271811.174631:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096384 00000100:00100000:1.0:1736271811.174633:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096768 00000100:00100000:3.0:1736271811.174638:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:3.0:1736271811.174642:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f126d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024096320:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271811.174650:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00010000:02000000:3.0:1736271811.174652:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271811.174654:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b577200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024096384:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271811.174657:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1736271811.174661:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f125580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024096448:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271811.174662:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024096256:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271811.174667:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:02000000:0.0:1736271811.174668:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271811.174678:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f126d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024096320:12345-0@lo:38:kworker/u8:2.0 Request processed in 36us (172us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271811.174683:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1736271811.174711:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096704 00000100:00100000:3.0:1736271811.174715:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:3.0:1736271811.174718:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d552f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024096768:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271811.174726:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b577200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024096384:12345-0@lo:400:kworker/u8:2.0 Request processed in 71us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271811.174728:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f125580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024096448:12345-0@lo:38:kworker/u8:2.0 Request processed in 65us (179us total) trans 0 rc -19/-19 00010000:02000000:3.0:1736271811.174729:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271811.174730:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096640 00000100:00100000:0.0:1736271811.174733:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1736271811.174740:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:2.0:1736271811.174741:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7082 00000100:00100000:2.0:1736271811.174744:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998d97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024096704:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271811.174747:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d552f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024096768:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (140us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271811.174752:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00080000:0.0:1736271811.174759:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271811.174762:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271811.174764:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024096768:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271811.174765:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096576 00000100:00100000:2.0:1736271811.174766:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998d97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024096704:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271811.174768:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271811.174771:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7082 00000100:00100000:2.0:1736271811.174778:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7083 00000100:00080000:0.0:1736271811.174779:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271811.174780:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271811.174781:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112818 00000100:00100000:2.0:1736271811.174781:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998da140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024096640:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271811.174785:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f122140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024096576:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271811.174786:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096512 00000100:00100000:0.0:1736271811.174787:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb90e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024096448:0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271811.174792:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1736271811.174795:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271811.174797:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271811.174797:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998da140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024096640:12345-0@lo:400:kworker/u8:2.0 Request processed in 16us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271811.174799:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb93dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024096320:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271811.174802:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:3.0:1736271811.174805:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998dd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024096512:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271811.174810:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7083 00000100:00100000:1.0:1736271811.174813:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f122140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024096576:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (237us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271811.174819:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112818 00000100:00080000:0.0:1736271811.174821:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271811.174823:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271811.174825:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb950c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024096576:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271811.174831:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998dd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024096512:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (63us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271811.174836:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:1.0:1736271811.174855:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb96d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024096384:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271811.174856:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb92f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024096512:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271811.174878:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024096640:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271811.174885:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024096704:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271811.174891:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008fb97200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024096256:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271811.798465:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271812.800438:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271813.802433:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271814.804453:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271814.870449:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d552140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024096832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271814.870449:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800998d8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024096896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271814.870507:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271814.870560:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271814.870571:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096896 00000100:00100000:2.0:1736271814.870576:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096832 00000100:00100000:0.0:1736271814.870608:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5882 00000100:00100000:0.0:1736271814.870613:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b86aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024096896:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271814.870613:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5883 00000100:00100000:2.0:1736271814.870615:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024096832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271814.870632:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:0.0:1736271814.870633:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271814.870658:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024096832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271814.870680:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5883 00000100:00100000:0.0:1736271814.870687:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b86aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024096896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271814.870693:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5882 00000100:00100000:1.0:1736271814.870706:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d552140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024096832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271814.870711:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800998d8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024096896:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271815.806454:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271815.948541:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271815.948591:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271815.948622:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976768 00000100:00100000:0.0:1736271815.948645:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271815.948688:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976896 00000100:00100000:3.0:1736271815.948699:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 288 00000100:00100000:3.0:1736271815.948706:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058976768:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271815.948722:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976832 00000100:00100000:0.0:1736271815.948734:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 813 00000100:00100000:0.0:1736271815.948739:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d555a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058976896:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271815.948740:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1086 00000100:00100000:1.0:1736271815.948744:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d552140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058976832:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271815.948758:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271815.948781:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058976768:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 76us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271815.948784:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d555a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058976896:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 45us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271815.948788:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d552140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058976832:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 43us (145us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271815.948788:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 288 00000100:00100000:1.0:1736271815.948793:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1086 00000100:00100000:0.0:1736271815.948803:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 813 00000100:00080000:2.0:1736271816.182409:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271816.182415:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271816.182417:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271816.182423:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8596 00000100:00080000:2.0:1736271816.182427:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271816.182431:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271816.182449:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024096960:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271816.182449:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012b86a600 x1820604024097024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271816.182475:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271816.182478:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271816.182479:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271816.182481:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8596 00000100:00080000:2.0:1736271816.182483:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00100000:3.0:1736271816.182487:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024097088:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271816.182497:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271816.182505:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800897c4740 x1820604024097152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271816.182508:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271816.182518:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271816.182519:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271816.182520:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271816.182521:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271816.182522:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8596 00000100:00080000:2.0:1736271816.182523:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271816.182525:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271816.182530:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800897c5f00 x1820604024097280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271816.182539:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024097024:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271816.182549:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736271816.182550:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097088 00000100:00100000:3.0:1736271816.182550:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024096960 00000100:00080000:2.0:1736271816.182552:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271816.182552:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271816.182555:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8596 00000100:00080000:2.0:1736271816.182557:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271816.182559:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271816.182567:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf584c0 x1820604024097472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271816.182573:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:0.0:1736271816.182577:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998d8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024097088:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271816.182581:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1736271816.182585:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024096960:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271816.182593:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024097344:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271816.182596:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271816.182618:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998d8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024097088:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271816.182619:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024096960:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271816.182624:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271816.182625:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:3.0:1736271816.182625:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1736271816.182637:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097024 00000100:00100000:1.0:1736271816.182642:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024097152:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271816.182643:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271816.182648:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1736271816.182648:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024097216:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271816.182650:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024097024:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271816.182672:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024097088:0@lo:400:kworker/u8:2.0 00010000:02000000:0.0:1736271816.182676:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271816.182677:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271816.182682:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736271816.182686:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf597c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024097408:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271816.182692:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097152 00000100:00100000:0.0:1736271816.182700:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024097024:12345-0@lo:38:kworker/u8:2.0 Request processed in 49us (105us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271816.182704:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1736271816.182706:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800897c5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024097280:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271816.182706:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271816.182707:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:2.0:1736271816.182711:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024097152:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271816.182718:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097344 00010000:02000000:2.0:1736271816.182722:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271816.182728:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097408 00000100:00100000:1.0:1736271816.182732:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271816.182735:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7084 00000100:00100000:0.0:1736271816.182738:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ac2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024097344:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271816.182746:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7085 00000100:00100000:1.0:1736271816.182747:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf584c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024097472:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271816.182750:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024097152:12345-0@lo:38:kworker/u8:2.0 Request processed in 39us (74us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271816.182750:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998dcc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024097408:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271816.182755:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:0.0:1736271816.182772:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ac2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024097344:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271816.182775:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271816.182778:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7084 00000100:00100000:2.0:1736271816.182794:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024097344:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271816.182794:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998dcc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024097408:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271816.182796:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097216 00000100:00100000:3.0:1736271816.182800:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7085 00000100:00100000:0.0:1736271816.182809:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024096960:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271816.182816:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271816.182822:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097472 00000100:00100000:0.0:1736271816.182827:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:3.0:1736271816.182829:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf597c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024097408:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271816.182832:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ac1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024097216:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271816.182834:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271816.182835:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271816.182836:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:2.0:1736271816.182837:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024097024:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271816.182840:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024097472:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271816.182843:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271816.182844:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271816.182846:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024097152:0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271816.182850:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271816.182859:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097280 00000100:00100000:3.0:1736271816.182874:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112819 00000100:00100000:3.0:1736271816.182877:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024097280:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271816.182881:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ac1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024097216:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (105us total) trans 0 rc 0/0 00010000:02000000:3.0:1736271816.182882:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271816.182883:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024097216:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271816.182888:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:1.0:1736271816.182888:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024097472:12345-0@lo:38:kworker/u8:2.0 Request processed in 47us (71us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271816.182894:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00080000:2.0:1736271816.182896:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271816.182898:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271816.182899:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf584c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024097472:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271816.182904:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024097280:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (171us total) trans 0 rc -19/-19 00000100:00080000:2.0:1736271816.182908:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271816.182909:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271816.182911:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800897c5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024097280:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271816.182918:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112819 00010000:00010000:2.0:1736271816.808459:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271817.810453:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271818.812431:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271819.814450:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271819.878446:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736271819.878448:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271819.878461:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024097600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271819.878461:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009351e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024097536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271819.878514:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271819.878540:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097600 00000100:00100000:3.0:1736271819.878547:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271819.878564:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097536 00000100:00100000:0.0:1736271819.878570:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5884 00000100:00100000:0.0:1736271819.878574:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b86a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024097600:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271819.878576:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5885 00000100:00100000:3.0:1736271819.878579:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf584c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024097536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271819.878593:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:3.0:1736271819.878593:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271819.878622:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b86a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024097600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271819.878626:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf584c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024097536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271819.878641:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5884 00000100:00100000:3.0:1736271819.878648:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5885 00000100:00100000:1.0:1736271819.878659:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b86a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024097600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271819.878672:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009351e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024097536:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271820.816425:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271820.956604:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271820.956669:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271820.956682:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058976960 00000100:00100000:0.0:1736271820.956700:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271820.956717:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977088 00000100:00100000:3.0:1736271820.956723:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 290 00000100:00100000:3.0:1736271820.956728:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058976960:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271820.956736:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977024 00000100:00100000:1.0:1736271820.956742:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 816 00000100:00100000:1.0:1736271820.956747:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b86a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058977088:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271820.956752:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1090 00000100:00100000:0.0:1736271820.956754:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb97200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058977024:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271820.956764:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271820.956780:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058976960:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 52us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271820.956781:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b86a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058977088:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 34us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271820.956782:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb97200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058977024:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 27us (82us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271820.956786:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 816 00000100:00100000:3.0:1736271820.956787:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 290 00000100:00100000:0.0:1736271820.956788:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1090 00000100:00080000:2.0:1736271821.190414:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271821.190420:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271821.190423:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271821.190428:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8601 00000100:00080000:2.0:1736271821.190431:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271821.190435:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271821.190450:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009351e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024097664:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271821.190451:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009351cc00 x1820604024097728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271821.190486:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271821.190489:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271821.190490:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271821.190492:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8601 00000100:00080000:2.0:1736271821.190493:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271821.190495:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271821.190503:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009351d580 x1820604024097856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271821.190505:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009351c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024097792:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271821.190510:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271821.190512:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009351cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024097728:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271821.190516:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271821.190518:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271821.190519:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271821.190521:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8601 00000100:00080000:2.0:1736271821.190523:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271821.190529:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271821.190538:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b99f6c0 x1820604024097984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271821.190548:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271821.190551:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1736271821.190557:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271821.190557:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b99df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024097920:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271821.190560:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1736271821.190561:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024098048:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271821.190561:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271821.190564:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8601 00000100:00080000:2.0:1736271821.190565:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271821.190567:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271821.190574:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d5f00 x1820604024098176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271821.190577:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271821.190582:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271821.190588:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097792 00000100:00100000:0.0:1736271821.190597:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024098112:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271821.190600:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098048 00000100:00100000:3.0:1736271821.190603:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271821.190613:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271821.190639:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097920 00000100:00100000:2.0:1736271821.190642:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098112 00000100:00100000:3.0:1736271821.190650:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009351d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024097856:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271821.190657:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097728 00000100:00100000:2.0:1736271821.190657:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7086 00000100:00100000:0.0:1736271821.190661:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7087 00000100:00100000:2.0:1736271821.190662:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb92f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024098048:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271821.190664:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb96d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024098112:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271821.190669:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:3.0:1736271821.190670:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271821.190672:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d2df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024097792:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271821.190677:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b99f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024097984:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271821.190699:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb96d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024098112:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271821.190700:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271821.190703:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb92f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024098048:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271821.190705:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7087 00000100:00100000:2.0:1736271821.190707:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7086 00000100:00100000:1.0:1736271821.190710:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d2df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024097792:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271821.190711:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024098176:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271821.190716:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:2.0:1736271821.190726:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097856 00000100:00100000:1.0:1736271821.190728:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:1.0:1736271821.190731:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf597c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024097920:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271821.190732:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1736271821.190734:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024097728:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271821.190734:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271821.190737:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098176 00000100:00100000:2.0:1736271821.190743:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00010000:02000000:0.0:1736271821.190744:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271821.190746:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024097856:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271821.190750:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271821.190755:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf597c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024097920:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271821.190755:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:3.0:1736271821.190758:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024098176:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271821.190760:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00010000:02000000:3.0:1736271821.190765:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271821.190768:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024097728:12345-0@lo:38:kworker/u8:2.0 Request processed in 33us (166us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271821.190768:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024097856:12345-0@lo:38:kworker/u8:2.0 Request processed in 21us (98us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271821.190773:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1736271821.190775:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:3.0:1736271821.190785:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024098176:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (51us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271821.190791:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009351c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024097792:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271821.190791:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1736271821.190794:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024098112:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271821.190801:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097984 00000100:00100000:0.0:1736271821.190802:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024098048:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271821.190813:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271821.190816:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271821.190819:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009351d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024097856:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271821.190820:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112820 00000100:00100000:2.0:1736271821.190822:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024097984:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271821.190823:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024097664 00000100:00080000:3.0:1736271821.190825:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271821.190826:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00010000:02000000:2.0:1736271821.190828:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271821.190829:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024098176:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271821.190834:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271821.190836:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271821.190838:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009351cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024097728:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271821.190842:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1736271821.190845:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024097664:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271821.190846:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024097984:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (147us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271821.190851:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112820 00000100:00080000:3.0:1736271821.190855:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271821.190857:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271821.190859:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b99f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024097984:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271821.190867:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024097664:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271821.190871:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1736271821.190879:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009351e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024097664:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271821.190880:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b99df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024097920:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271821.818425:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271822.820460:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271823.822431:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271824.824436:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271824.886445:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024098304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271824.886445:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009351e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024098240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271824.886501:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271824.886549:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271824.886571:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098240 00000100:00100000:1.0:1736271824.886592:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098304 00000100:00100000:2.0:1736271824.886621:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5886 00000100:00100000:2.0:1736271824.886626:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897c17c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024098240:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271824.886642:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5887 00000100:00100000:1.0:1736271824.886645:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb950c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024098304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271824.886650:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:1.0:1736271824.886658:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271824.886685:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897c17c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024098240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271824.886688:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb950c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024098304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271824.886690:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5886 00000100:00100000:1.0:1736271824.886693:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5887 00000100:00100000:0.0:1736271824.886704:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024098304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271824.886705:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009351e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024098240:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271825.826462:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271825.964378:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271825.964423:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271825.964452:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977280 00000100:00100000:0.0:1736271825.964470:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271825.964478:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977152 00000100:00100000:1.0:1736271825.964501:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977216 00000100:00100000:2.0:1736271825.964502:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 292 00000100:00100000:2.0:1736271825.964507:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058977152:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271825.964513:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 819 00000100:00100000:1.0:1736271825.964516:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb93dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058977280:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271825.964519:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1094 00000100:00100000:0.0:1736271825.964522:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb90e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058977216:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271825.964533:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271825.964559:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb93dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058977280:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 42us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271825.964560:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb90e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058977216:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 36us (90us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271825.964560:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058977152:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 52us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271825.964564:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1094 00000100:00100000:2.0:1736271825.964565:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 292 00000100:00100000:1.0:1736271825.964567:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 819 00000100:00080000:2.0:1736271826.198424:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271826.198433:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271826.198437:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271826.198442:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8606 00000100:00080000:2.0:1736271826.198446:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1736271826.198455:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024098368:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271826.198461:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271826.198478:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d1300 x1820604024098432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271826.198520:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271826.198520:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271826.198523:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271826.198524:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271826.198527:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8606 00000100:00080000:2.0:1736271826.198528:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271826.198531:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271826.198539:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d4c00 x1820604024098560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271826.198543:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024098432:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271826.198545:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271826.198549:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024098496:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271826.198556:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271826.198559:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271826.198560:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271826.198562:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8606 00000100:00080000:2.0:1736271826.198564:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271826.198566:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271826.198572:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271826.198574:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d6d40 x1820604024098688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271826.198575:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736271826.198583:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024098624:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271826.198598:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1736271826.198605:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736271826.198607:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024098752:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271826.198608:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271826.198610:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271826.198612:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8606 00000100:00080000:2.0:1736271826.198613:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271826.198616:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271826.198622:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098496 00000100:00100000:3.0:1736271826.198628:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271826.198629:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0980 x1820604024098880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271826.198645:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271826.198648:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098624 00000100:00100000:2.0:1736271826.198649:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098368 00000100:00100000:1.0:1736271826.198658:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:1.0:1736271826.198662:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024098496:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271826.198662:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:3.0:1736271826.198665:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b99df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024098624:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271826.198667:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1736271826.198670:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024098368:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271826.198673:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271826.198680:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024098816:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271826.198701:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b99df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024098624:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271826.198702:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024098496:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271826.198702:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024098368:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271826.198704:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271826.198707:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1736271826.198707:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:1.0:1736271826.198709:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:3.0:1736271826.198726:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271826.198728:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098752 00000100:00100000:2.0:1736271826.198729:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098816 00000100:00100000:1.0:1736271826.198734:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024098496:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271826.198740:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024098560:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271826.198741:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024098368:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271826.198746:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7088 00000100:00100000:2.0:1736271826.198749:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024098816:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271826.198755:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271826.198758:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7089 00000100:00100000:3.0:1736271826.198760:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024098688:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271826.198762:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9ef200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024098752:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271826.198770:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098432 00000100:00100000:2.0:1736271826.198773:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024098816:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (69us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271826.198773:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271826.198778:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7088 00000100:00100000:1.0:1736271826.198780:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098560 00000100:00100000:3.0:1736271826.198781:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024098880:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271826.198789:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1736271826.198794:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b99f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024098432:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271826.198794:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271826.198795:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9ef200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024098752:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271826.198798:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098688 00000100:00100000:0.0:1736271826.198799:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7089 00010000:02000000:1.0:1736271826.198803:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271826.198808:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098880 00000100:00100000:2.0:1736271826.198809:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112821 00000100:00100000:2.0:1736271826.198811:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934eaf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024098688:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271826.198816:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271826.198817:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024098816:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271826.198822:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:3.0:1736271826.198824:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024098560:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271826.198826:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b99f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024098432:12345-0@lo:38:kworker/u8:2.0 Request processed in 33us (100us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271826.198830:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024098752:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271826.198830:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934eaf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024098688:12345-0@lo:38:kworker/u8:2.0 Request processed in 18us (56us total) trans 0 rc -19/-19 00010000:02000000:3.0:1736271826.198831:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271826.198832:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1736271826.198834:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112821 00000100:00100000:1.0:1736271826.198845:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1736271826.198847:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024098880:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271826.198850:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024098560:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (95us total) trans 0 rc -19/-19 00010000:02000000:1.0:1736271826.198853:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271826.198856:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:1.0:1736271826.198870:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024098880:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (77us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271826.198874:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00080000:3.0:1736271826.198878:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271826.198886:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271826.198889:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024098560:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271826.198896:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271826.198898:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271826.198899:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024098688:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271826.198903:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271826.198904:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271826.198905:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024098880:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271826.198909:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271826.198910:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271826.198911:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024098432:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271826.198933:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024098624:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271826.828451:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271827.830463:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271828.832450:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271829.834423:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271829.894423:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271829.894440:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009aae7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024099008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271829.894441:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024098944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271829.894500:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271829.894538:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099008 00000100:00100000:3.0:1736271829.894550:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271829.894606:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024098944 00000100:00100000:0.0:1736271829.894613:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5888 00000100:00100000:0.0:1736271829.894619:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aae5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024099008:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271829.894625:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5889 00000100:00100000:2.0:1736271829.894628:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ecc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024098944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271829.894644:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271829.894644:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271829.894683:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ecc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024098944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271829.894688:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aae5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024099008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271829.894689:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5889 00000100:00100000:0.0:1736271829.894694:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5888 00000100:00100000:3.0:1736271829.894703:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800934e8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024098944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271829.894754:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009aae7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024099008:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271830.836436:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271830.972463:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271830.972513:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271830.972538:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977344 00000100:00100000:0.0:1736271830.972573:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271830.972604:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 294 00000100:00100000:0.0:1736271830.972605:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977472 00000100:00100000:2.0:1736271830.972610:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058977344:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271830.972620:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977408 00000100:00100000:0.0:1736271830.972629:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 822 00000100:00100000:0.0:1736271830.972632:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aae04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058977472:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271830.972643:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1098 00000100:00100000:1.0:1736271830.972647:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aae7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058977408:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271830.972657:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271830.972671:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058977344:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 61us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271830.972672:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aae04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058977472:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 39us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271830.972678:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 822 00000100:00100000:2.0:1736271830.972678:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 294 00000100:00100000:1.0:1736271830.972682:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aae7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058977408:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 35us (127us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271830.972688:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1098 00000100:00080000:2.0:1736271831.206431:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271831.206437:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271831.206439:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271831.206445:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8611 00000100:00080000:2.0:1736271831.206447:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271831.206452:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271831.206463:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024099072:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271831.206469:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d1300 x1820604024099136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271831.206497:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024099136:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271831.206506:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271831.206509:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271831.206510:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271831.206513:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8611 00000100:00080000:2.0:1736271831.206515:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271831.206518:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271831.206523:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271831.206529:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d6d40 x1820604024099264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271831.206529:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271831.206568:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024099200:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271831.206572:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024099264:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271831.206573:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271831.206576:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271831.206577:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271831.206580:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8611 00000100:00080000:2.0:1736271831.206581:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1736271831.206582:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024099328:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271831.206584:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271831.206593:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d1c80 x1820604024099392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271831.206594:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271831.206614:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271831.206617:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271831.206618:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099136 00000100:00080000:2.0:1736271831.206618:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736271831.206620:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099264 00000100:00080000:2.0:1736271831.206620:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8611 00000100:00080000:2.0:1736271831.206622:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271831.206624:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271831.206626:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024099392:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271831.206631:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d5a40 x1820604024099584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271831.206640:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1736271831.206644:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271831.206645:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ed580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024099264:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271831.206650:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:1.0:1736271831.206653:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024099136:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271831.206653:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099072 00010000:02000000:1.0:1736271831.206662:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736271831.206663:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271831.206663:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024099584:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271831.206677:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1736271831.206680:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024099072:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271831.206682:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271831.206695:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ed580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024099264:12345-0@lo:38:kworker/u8:2.0 Request processed in 51us (101us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271831.206695:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024099136:12345-0@lo:38:kworker/u8:2.0 Request processed in 40us (166us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271831.206700:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1736271831.206702:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00080000:3.0:1736271831.206705:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271831.206707:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271831.206710:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099584 00000100:00100000:3.0:1736271831.206710:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024099264:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271831.206714:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024099072:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271831.206717:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271831.206718:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00080000:3.0:1736271831.206718:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271831.206719:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024099584:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271831.206719:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:3.0:1736271831.206720:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271831.206722:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024099136:0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271831.206723:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271831.206735:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024099584:12345-0@lo:38:kworker/u8:2.0 Request processed in 15us (53us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271831.206738:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:1.0:1736271831.206741:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099200 00000100:00100000:2.0:1736271831.206744:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099392 00000100:00080000:3.0:1736271831.206748:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271831.206749:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736271831.206750:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271831.206753:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024099584:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271831.206758:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112822 00000100:00100000:2.0:1736271831.206761:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ed0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024099392:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271831.206763:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099328 00000100:00100000:1.0:1736271831.206765:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1736271831.206768:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024099200:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271831.206772:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00010000:02000000:2.0:1736271831.206774:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271831.206776:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024099328:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271831.206784:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024099520:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271831.206807:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271831.206812:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ed0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024099392:12345-0@lo:38:kworker/u8:2.0 Request processed in 49us (167us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271831.206813:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024099200:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271831.206813:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024099328:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271831.206818:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1736271831.206818:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112822 00000100:00100000:3.0:1736271831.206822:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:0.0:1736271831.206826:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024099072:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271831.206838:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024099456:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271831.206844:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024099200:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271831.206846:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099520 00000100:00100000:3.0:1736271831.206857:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271831.206864:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099456 00000100:00100000:2.0:1736271831.206872:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7090 00000100:00100000:0.0:1736271831.206876:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7091 00000100:00100000:2.0:1736271831.206877:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafd580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024099520:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271831.206880:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024099456:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271831.206881:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271831.206883:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271831.206885:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024099392:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271831.206907:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafd580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024099520:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271831.206909:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024099456:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (52us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271831.206912:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7090 00000100:00100000:0.0:1736271831.206915:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7091 00000100:00100000:3.0:1736271831.206923:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024099520:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271831.206937:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024099328:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271831.206938:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024099456:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271831.838459:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271832.840596:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271833.842429:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271834.844656:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271834.902423:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736271834.902445:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024099712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271834.902504:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271834.902547:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009351c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024099648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271834.902566:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099712 00000100:00100000:1.0:1736271834.902568:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271834.902591:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099648 00000100:00100000:2.0:1736271834.902607:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5890 00000100:00100000:2.0:1736271834.902610:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024099712:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271834.902613:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5891 00000100:00100000:3.0:1736271834.902617:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b358980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024099648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271834.902630:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:3.0:1736271834.902633:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271834.902662:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024099712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271834.902665:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b358980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024099648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271834.902666:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5890 00000100:00100000:3.0:1736271834.902669:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5891 00000100:00100000:1.0:1736271834.902701:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024099712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271834.902711:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009351c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024099648:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271835.846432:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271835.980462:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271835.980506:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271835.980544:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977536 00000100:00100000:2.0:1736271835.980575:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 296 00000100:00100000:2.0:1736271835.980579:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058977536:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271835.980594:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271835.980617:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977664 00000100:00100000:0.0:1736271835.980625:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977600 00000100:00100000:2.0:1736271835.980632:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058977536:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 53us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271835.980636:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 296 00000100:00100000:0.0:1736271835.980639:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 825 00000100:00100000:0.0:1736271835.980642:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058977664:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271835.980648:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1102 00000100:00100000:3.0:1736271835.980652:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aafa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058977600:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736271835.980664:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271835.980665:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058977664:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 22us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271835.980669:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 825 00000100:00100000:3.0:1736271835.980689:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aafa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058977600:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 36us (95us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271835.980693:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1102 00000100:00080000:2.0:1736271836.214400:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271836.214414:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271836.214416:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271836.214420:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8616 00000100:00080000:2.0:1736271836.214423:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271836.214426:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271836.214439:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024099776:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271836.214442:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0e40 x1820604024099840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271836.214460:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024099840:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271836.214466:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271836.214470:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271836.214471:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271836.214473:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8616 00000100:00080000:2.0:1736271836.214474:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271836.214477:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271836.214485:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d3dc0 x1820604024099968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271836.214501:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271836.214501:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271836.214504:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271836.214506:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271836.214507:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271836.214509:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8616 00000100:00080000:2.0:1736271836.214511:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271836.214513:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271836.214517:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736271836.214536:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d4c00 x1820604024100096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271836.214539:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271836.214541:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024099968:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271836.214541:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024100032:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271836.214543:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024099904:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271836.214553:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271836.214556:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271836.214561:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736271836.214562:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271836.214564:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8616 00000100:00080000:2.0:1736271836.214565:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271836.214568:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271836.214569:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736271836.214574:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024100224:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271836.214576:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0980 x1820604024100288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271836.214583:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024100096:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271836.214583:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099840 00000100:00100000:1.0:1736271836.214595:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271836.214598:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099776 00000100:00100000:3.0:1736271836.214602:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099968 00000100:00100000:0.0:1736271836.214604:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271836.214614:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:1.0:1736271836.214617:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100224 00000100:00100000:2.0:1736271836.214619:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1736271836.214619:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024099840:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271836.214620:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024100288:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271836.214622:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024099776:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:3.0:1736271836.214629:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271836.214635:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271836.214637:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7092 00000100:00100000:1.0:1736271836.214639:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b35ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024100224:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271836.214654:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271836.214658:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024099776:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271836.214659:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024100160:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271836.214663:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024099840:12345-0@lo:38:kworker/u8:2.0 Request processed in 44us (161us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271836.214664:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b35ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024100224:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (70us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271836.214664:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1736271836.214669:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:0.0:1736271836.214671:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271836.214677:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7092 00000100:00100000:3.0:1736271836.214686:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100288 00000100:00100000:0.0:1736271836.214687:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:1.0:1736271836.214687:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100160 00000100:00100000:0.0:1736271836.214690:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024099968:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271836.214694:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00010000:02000000:0.0:1736271836.214696:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271836.214698:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024100288:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271836.214699:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7093 00000100:00100000:1.0:1736271836.214701:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a17c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024100160:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271836.214703:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:2.0:1736271836.214704:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271836.214724:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024099776:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271836.214726:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024099968:12345-0@lo:38:kworker/u8:2.0 Request processed in 35us (164us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271836.214727:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a17c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024100160:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (56us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271836.214727:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024100288:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (91us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271836.214732:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:1.0:1736271836.214732:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7093 00000100:00100000:2.0:1736271836.214741:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:3.0:1736271836.214743:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024099904 00000100:00100000:1.0:1736271836.214751:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271836.214758:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100096 00000100:00100000:3.0:1736271836.214763:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100032 00000100:00100000:0.0:1736271836.214767:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:2.0:1736271836.214771:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112823 00000100:00100000:2.0:1736271836.214774:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024100096:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271836.214775:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024100224:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271836.214778:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846484c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024099904:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:2.0:1736271836.214779:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271836.214785:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:3.0:1736271836.214788:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3584c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024100032:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271836.214800:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024100096:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (195us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271836.214805:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112823 00000100:00100000:0.0:1736271836.214810:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846484c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024099904:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271836.214813:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3584c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024100032:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271836.214815:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1736271836.214818:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:1.0:1736271836.214827:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024100032:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271836.214828:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271836.214834:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271836.214837:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024100288:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271836.214838:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024100160:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271836.214839:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024099904:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271836.214847:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271836.214849:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271836.214851:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024100096:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271836.214857:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271836.214859:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271836.214861:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024099968:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271836.214873:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271836.214874:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271836.214876:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024099840:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271836.848432:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271837.850456:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271838.852530:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271839.854449:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271839.910466:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271839.910475:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024100416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271839.910478:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024100352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271839.910545:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271839.910575:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100416 00000100:00100000:3.0:1736271839.910613:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5892 00000100:00100000:3.0:1736271839.910619:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a1c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024100416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1736271839.910647:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736271839.910689:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a1c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024100416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271839.910696:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5892 00000100:00100000:0.0:1736271839.910715:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024100416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271839.910722:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271839.910762:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100352 00000100:00100000:2.0:1736271839.910804:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5893 00000100:00100000:2.0:1736271839.910809:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024100352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271839.910832:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271839.910894:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024100352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271839.910901:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5893 00000100:00100000:3.0:1736271839.910926:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024100352:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271840.856544:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271840.988578:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271840.988616:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271840.988651:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271840.988656:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977728 00000100:00100000:3.0:1736271840.988671:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977856 00000100:00100000:0.0:1736271840.988691:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977792 00000100:00100000:2.0:1736271840.988694:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 298 00000100:00100000:2.0:1736271840.988699:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058977728:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271840.988708:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 828 00000100:00100000:3.0:1736271840.988712:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058977856:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271840.988722:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1106 00000100:00100000:0.0:1736271840.988725:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058977792:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271840.988737:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271840.988750:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058977728:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 52us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271840.988752:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058977856:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 39us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271840.988757:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058977792:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 32us (106us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271840.988759:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 828 00000100:00100000:2.0:1736271840.988760:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 298 00000100:00100000:0.0:1736271840.988762:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1106 00000100:00080000:2.0:1736271841.222451:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271841.222457:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271841.222460:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271841.222467:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8621 00000100:00080000:2.0:1736271841.222472:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271841.222477:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271841.222508:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d3dc0 x1820604024100544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271841.222517:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271841.222537:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024100480:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271841.222547:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271841.222550:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271841.222551:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271841.222554:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8621 00000100:00080000:2.0:1736271841.222555:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271841.222558:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271841.222559:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736271841.222565:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0980 x1820604024100672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271841.222570:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024100608:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271841.222577:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271841.222580:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271841.222581:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271841.222582:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024100544:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271841.222583:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8621 00000100:00080000:2.0:1736271841.222585:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271841.222587:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271841.222596:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d5a40 x1820604024100800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271841.222601:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271841.222601:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271841.222629:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271841.222631:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271841.222632:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271841.222633:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024100736:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271841.222634:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8621 00000100:00100000:0.0:1736271841.222635:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024100864:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271841.222635:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271841.222638:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271841.222641:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271841.222644:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0000 x1820604024100992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271841.222647:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024100928:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271841.222666:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271841.222669:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271841.222669:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024100672:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271841.222675:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100480 00000100:00100000:3.0:1736271841.222691:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271841.222697:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100864 00000100:00100000:0.0:1736271841.222700:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100608 00000100:00100000:2.0:1736271841.222709:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1736271841.222710:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024100800:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271841.222715:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024100480:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271841.222722:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7094 00000100:00100000:1.0:1736271841.222725:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024100864:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271841.222731:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271841.222734:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:0.0:1736271841.222738:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b35cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024100608:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271841.222745:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024100992:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271841.222768:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024100480:12345-0@lo:400:kworker/u8:2.0 Request processed in 53us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271841.222775:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024100864:12345-0@lo:400:kworker/u8:2.0 Request processed in 48us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271841.222776:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1736271841.222781:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7094 00000100:00100000:0.0:1736271841.222784:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b35cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024100608:12345-0@lo:400:kworker/u8:2.0 Request processed in 46us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271841.222786:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271841.222790:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:0.0:1736271841.222803:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100544 00000100:00100000:2.0:1736271841.222812:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100736 00000100:00100000:0.0:1736271841.222813:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100992 00000100:00100000:1.0:1736271841.222813:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100672 00000100:00100000:3.0:1736271841.222820:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1736271841.222824:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024100544:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271841.222828:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1736271841.222830:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024100992:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271841.222837:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00010000:02000000:3.0:1736271841.222838:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736271841.222841:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271841.222842:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024100736:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271841.222842:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1736271841.222846:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084649c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024100672:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271841.222853:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271841.222877:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024100544:12345-0@lo:38:kworker/u8:2.0 Request processed in 52us (237us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271841.222878:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024100992:12345-0@lo:38:kworker/u8:2.0 Request processed in 47us (93us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271841.222886:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084649c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024100672:12345-0@lo:38:kworker/u8:2.0 Request processed in 38us (194us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271841.222887:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024100736:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271841.222887:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1736271841.222894:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1736271841.222897:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1736271841.222901:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:2.0:1736271841.222915:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100800 00000100:00080000:3.0:1736271841.222923:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271841.222925:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271841.222927:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271841.222930:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112824 00000100:00100000:3.0:1736271841.222930:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024100992:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271841.222932:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024100736:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271841.222933:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024100800:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271841.222939:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736271841.222939:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271841.222941:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271841.222943:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024100544:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271841.222944:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024100608:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271841.222954:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024100928 00000100:00080000:3.0:1736271841.222961:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271841.222963:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024100800:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (232us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736271841.222963:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271841.222966:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024100672:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271841.222968:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112824 00000100:00100000:1.0:1736271841.222969:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7095 00000100:00100000:0.0:1736271841.222970:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024100864:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271841.222972:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c485a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024100928:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271841.222977:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024100480:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271841.222996:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271841.222998:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271841.223001:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024100800:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271841.223005:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c485a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024100928:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271841.223010:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7095 00000100:00100000:0.0:1736271841.223018:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024100928:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271841.858442:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271842.860444:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271843.862441:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271844.864497:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271844.918398:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024101056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271844.918414:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024101120:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271844.918480:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271844.918515:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271844.918532:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101056 00000100:00100000:1.0:1736271844.918550:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101120 00000100:00100000:3.0:1736271844.918566:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5894 00000100:00100000:3.0:1736271844.918571:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024101056:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271844.918580:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5895 00000100:00100000:0.0:1736271844.918585:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024101120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1736271844.918598:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:0.0:1736271844.918600:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271844.918639:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024101120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271844.918641:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024101056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271844.918644:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5895 00000100:00100000:3.0:1736271844.918646:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5894 00000100:00100000:2.0:1736271844.918676:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024101056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271844.918698:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024101120:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271845.866448:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271845.996521:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271845.996561:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271845.996591:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977920 00000100:00100000:0.0:1736271845.996598:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271845.996635:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 300 00000100:00100000:2.0:1736271845.996640:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058977920:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271845.996654:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978048 00000100:00100000:3.0:1736271845.996664:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058977984 00000100:00100000:2.0:1736271845.996698:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058977920:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 57us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271845.996698:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 831 00000100:00100000:3.0:1736271845.996704:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058978048:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271845.996705:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 300 00000100:00100000:1.0:1736271845.996718:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1110 00000100:00100000:1.0:1736271845.996723:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058977984:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271845.996737:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271845.996737:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058978048:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 33us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271845.996744:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 831 00000100:00100000:1.0:1736271845.996778:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058977984:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 55us (181us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271845.996782:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1110 00000100:00080000:2.0:1736271846.230403:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271846.230407:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271846.230410:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271846.230414:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8626 00000100:00080000:2.0:1736271846.230416:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271846.230420:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271846.230432:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d1c80 x1820604024101248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271846.230440:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024101184:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271846.230464:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271846.230467:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271846.230469:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271846.230482:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8626 00000100:00080000:2.0:1736271846.230485:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271846.230488:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271846.230500:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d6d40 x1820604024101376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271846.230505:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024101248:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271846.230507:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271846.230521:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271846.230524:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271846.230525:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271846.230528:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8626 00000100:00080000:2.0:1736271846.230529:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271846.230532:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271846.230535:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271846.230538:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024101312:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271846.230539:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0980 x1820604024101504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271846.230540:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271846.230557:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024101568:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271846.230567:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271846.230569:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271846.230570:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736271846.230571:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101184 00000100:00080000:2.0:1736271846.230573:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8626 00000100:00080000:2.0:1736271846.230574:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:3.0:1736271846.230575:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024101376:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271846.230576:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271846.230581:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271846.230585:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d1300 x1820604024101696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271846.230593:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1736271846.230593:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271846.230596:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024101184:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271846.230598:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736271846.230602:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024101440:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271846.230610:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024101504:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271846.230613:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271846.230619:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101248 00000100:00100000:0.0:1736271846.230622:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024101184:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271846.230628:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1736271846.230630:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271846.230631:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101568 00000100:00100000:2.0:1736271846.230636:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101376 00000100:00100000:3.0:1736271846.230642:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024101696:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271846.230645:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101440 00000100:00100000:3.0:1736271846.230657:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271846.230659:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:1.0:1736271846.230659:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7096 00000100:00100000:0.0:1736271846.230664:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c485f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024101440:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271846.230664:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4850c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024101568:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271846.230664:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1736271846.230667:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024101248:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271846.230674:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101504 00010000:02000000:2.0:1736271846.230683:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271846.230688:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112825 00000100:00100000:3.0:1736271846.230691:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024101504:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271846.230695:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c485f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024101440:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (82us total) trans 0 rc 0/0 00010000:02000000:3.0:1736271846.230696:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271846.230700:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:1.0:1736271846.230701:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4850c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024101568:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271846.230707:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7096 00000100:00100000:2.0:1736271846.230712:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024101248:12345-0@lo:38:kworker/u8:2.0 Request processed in 44us (172us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271846.230712:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024101504:12345-0@lo:38:kworker/u8:2.0 Request processed in 20us (82us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271846.230714:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101696 00000100:00100000:2.0:1736271846.230717:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1736271846.230717:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112825 00000100:00100000:1.0:1736271846.230722:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271846.230724:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:0.0:1736271846.230727:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024101376:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271846.230727:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024101632:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271846.230727:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1736271846.230729:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024101696:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271846.230733:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736271846.230734:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736271846.230742:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271846.230744:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271846.230747:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024101504:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271846.230748:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271846.230751:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024101696:12345-0@lo:38:kworker/u8:2.0 Request processed in 21us (94us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736271846.230754:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271846.230755:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:0.0:1736271846.230756:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024101376:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (163us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736271846.230756:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271846.230758:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024101248:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271846.230765:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101632 00000100:00100000:0.0:1736271846.230768:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00080000:3.0:1736271846.230776:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271846.230778:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271846.230779:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7097 00000100:00100000:3.0:1736271846.230780:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024101696:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271846.230781:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024101632:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271846.230785:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271846.230787:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271846.230788:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024101376:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271846.230796:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024101440:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271846.230798:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024101632:12345-0@lo:400:kworker/u8:2.0 Request processed in 17us (51us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271846.230801:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7097 00000100:00100000:0.0:1736271846.230805:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024101568:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271846.230816:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024101632:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271846.230824:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271846.230850:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024101184:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271846.230859:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101312 00000100:00100000:2.0:1736271846.230877:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:2.0:1736271846.230880:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024101312:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271846.230915:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024101312:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271846.230920:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:0.0:1736271846.230928:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024101312:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271846.868489:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271847.870511:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271848.872399:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271849.874463:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271849.926393:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271849.926405:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c483900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024101760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271849.926405:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024101824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271849.926472:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271849.926528:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271849.926544:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101824 00000100:00100000:2.0:1736271849.926545:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101760 00000100:00100000:2.0:1736271849.926569:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5896 00000100:00100000:2.0:1736271849.926572:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c484740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024101760:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271849.926586:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5897 00000100:00100000:3.0:1736271849.926590:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024101824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271849.926591:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:3.0:1736271849.926605:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271849.926615:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c484740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024101760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271849.926619:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5896 00000100:00100000:1.0:1736271849.926634:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c483900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024101760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271849.926635:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024101824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271849.926641:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5897 00000100:00100000:2.0:1736271849.926652:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024101824:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271850.876498:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271851.004506:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271851.004544:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271851.004575:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271851.004600:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978112 00000100:00100000:3.0:1736271851.004602:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978240 00000100:00100000:2.0:1736271851.004643:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 302 00000100:00100000:3.0:1736271851.004643:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978176 00000100:00100000:2.0:1736271851.004647:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1893:x1820604058978112:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271851.004655:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 834 00000100:00100000:3.0:1736271851.004669:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1114 00000100:00100000:1.0:1736271851.004672:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1892:x1820604058978240:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271851.004673:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058978176:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736271851.004682:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271851.004715:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1893:x1820604058978112:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 67us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271851.004722:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 302 00000100:00100000:3.0:1736271851.004724:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058978176:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 51us (149us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271851.004727:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1892:x1820604058978240:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 57us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271851.004728:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1114 00000100:00100000:1.0:1736271851.004734:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 834 00000100:00080000:2.0:1736271851.238433:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271851.238439:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271851.238442:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271851.238448:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8631 00000100:00080000:2.0:1736271851.238451:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271851.238456:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271851.238462:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024101888:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271851.238474:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d2140 x1820604024101952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271851.238499:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024101952:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271851.238513:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271851.238517:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271851.238517:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736271851.238519:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271851.238520:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8631 00000100:00080000:2.0:1736271851.238522:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271851.238525:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271851.238533:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d4280 x1820604024102080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271851.238545:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271851.238545:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271851.238553:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024102016:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271851.238554:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024102144:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271851.238557:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271851.238558:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271851.238560:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8631 00000100:00080000:2.0:1736271851.238562:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271851.238564:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271851.238566:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024102080:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271851.238573:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d3dc0 x1820604024102208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271851.238576:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271851.238589:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271851.238595:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271851.238596:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101952 00000100:00080000:2.0:1736271851.238597:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271851.238598:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271851.238600:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8631 00000100:00080000:2.0:1736271851.238602:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:0.0:1736271851.238603:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024102336:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271851.238604:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271851.238609:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024102208:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271851.238611:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d1300 x1820604024102400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271851.238616:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102144 00000100:00100000:0.0:1736271851.238622:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271851.238628:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271851.238630:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024101888 00000100:00100000:1.0:1736271851.238632:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102080 00000100:00100000:0.0:1736271851.238636:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271851.238641:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024102272:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271851.238641:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024102400:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271851.238643:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:1.0:1736271851.238647:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024102144:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271851.238647:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1736271851.238650:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024101888:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271851.238658:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271851.238664:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271851.238678:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102336 00000100:00100000:1.0:1736271851.238682:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024102144:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271851.238683:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024101888:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271851.238688:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:2.0:1736271851.238688:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1736271851.238688:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102208 00000100:00100000:0.0:1736271851.238698:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102272 00000100:00100000:1.0:1736271851.238699:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102400 00000100:00100000:3.0:1736271851.238705:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112826 00000100:00100000:1.0:1736271851.238706:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1736271851.238709:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024101952:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271851.238709:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1736271851.238709:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024102208:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271851.238711:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7098 00000100:00100000:2.0:1736271851.238712:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024102080:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271851.238714:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc284c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024102336:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:1.0:1736271851.238718:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736271851.238718:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736271851.238723:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271851.238741:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024101952:12345-0@lo:38:kworker/u8:2.0 Request processed in 32us (197us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271851.238746:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc284c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024102336:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271851.238746:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1736271851.238747:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024102080:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (158us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271851.238750:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024102208:12345-0@lo:38:kworker/u8:2.0 Request processed in 42us (122us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271851.238755:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:3.0:1736271851.238756:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112826 00000100:00100000:0.0:1736271851.238758:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7098 00000100:00100000:1.0:1736271851.238758:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024102400:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271851.238758:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00010000:02000000:1.0:1736271851.238763:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271851.238770:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7099 00000100:00100000:0.0:1736271851.238773:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024102272:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271851.238778:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024102400:12345-0@lo:38:kworker/u8:2.0 Request processed in 19us (114us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271851.238782:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00080000:3.0:1736271851.238794:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271851.238797:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271851.238799:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024102272:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271851.238800:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024102400:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271851.238801:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271851.238804:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7099 00000100:00080000:3.0:1736271851.238807:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271851.238809:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271851.238811:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024102208:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271851.238818:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271851.238820:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102016 00000100:00080000:3.0:1736271851.238820:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271851.238822:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024102080:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271851.238827:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271851.238829:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271851.238830:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024102144:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271851.238831:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024101952:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271851.238834:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:2.0:1736271851.238837:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c483900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024102016:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271851.238851:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024102272:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271851.238858:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024102336:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271851.238863:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c483900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024102016:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271851.238865:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024101888:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271851.238868:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:1.0:1736271851.238873:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024102016:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271851.878458:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271852.880461:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271853.882516:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271854.884440:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271854.934436:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c482f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024102528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271854.934450:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024102464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271854.934497:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271854.934527:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102464 00000100:00100000:2.0:1736271854.934558:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5898 00000100:00100000:2.0:1736271854.934563:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024102464:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271854.934564:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271854.934583:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102528 00002000:00000024:2.0:1736271854.934587:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271854.934609:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5899 00000100:00100000:0.0:1736271854.934612:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024102528:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271854.934618:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024102464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271854.934623:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5898 00002000:00000024:0.0:1736271854.934625:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271854.934655:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024102528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271854.934660:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5899 00000100:00100000:3.0:1736271854.934680:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c482f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024102528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271854.934685:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024102464:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271855.886493:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271856.012528:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271856.012574:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271856.012616:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978304 00000100:00100000:0.0:1736271856.012632:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271856.012653:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978368 00000100:00100000:1.0:1736271856.012672:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978432 00000100:00100000:3.0:1736271856.012676:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 304 00000100:00100000:3.0:1736271856.012681:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1893:x1820604058978304:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271856.012687:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 837 00000100:00100000:1.0:1736271856.012691:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1892:x1820604058978432:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271856.012701:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1118 00000100:00100000:0.0:1736271856.012708:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058978368:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271856.012725:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271856.012745:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1892:x1820604058978432:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 53us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271856.012746:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1893:x1820604058978304:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 64us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271856.012749:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 837 00000100:00100000:3.0:1736271856.012757:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 304 00000100:00100000:0.0:1736271856.012766:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058978368:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 54us (187us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271856.012771:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1118 00000100:00080000:2.0:1736271856.246468:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271856.246476:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271856.246480:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271856.246487:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8636 00000100:00080000:2.0:1736271856.246492:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271856.246499:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271856.246520:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d1c80 x1820604024102656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271856.246533:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024102592:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271856.246564:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271856.246567:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271856.246568:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271856.246572:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8636 00000100:00080000:2.0:1736271856.246573:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271856.246577:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271856.246587:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0000 x1820604024102784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271856.246604:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271856.246621:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271856.246625:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271856.246626:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271856.246629:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8636 00000100:00080000:2.0:1736271856.246631:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271856.246634:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271856.246641:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736271856.246647:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024102720:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271856.246649:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d5a40 x1820604024102912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271856.246661:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024102848:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271856.246669:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271856.246671:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271856.246675:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271856.246676:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271856.246679:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8636 00000100:00080000:2.0:1736271856.246681:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271856.246684:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271856.246686:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271856.246687:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024103040:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271856.246693:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d3dc0 x1820604024103104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271856.246702:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271856.246707:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024102976:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271856.246715:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102720 00000100:00100000:3.0:1736271856.246729:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271856.246734:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102848 00000100:00100000:2.0:1736271856.246743:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102592 00000100:00100000:0.0:1736271856.246750:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:0.0:1736271856.246755:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024102720:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271856.246755:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:1.0:1736271856.246758:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c481c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024102848:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271856.246773:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024102656:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271856.246793:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c481c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024102848:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271856.246795:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1736271856.246800:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:0.0:1736271856.246801:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024102720:12345-0@lo:400:kworker/u8:2.0 Request processed in 46us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271856.246801:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024102592:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271856.246804:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271856.246807:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:1.0:1736271856.246813:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102656 00000100:00100000:3.0:1736271856.246814:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024102784:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271856.246823:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103040 00000100:00100000:1.0:1736271856.246826:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1736271856.246830:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846604c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024102656:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271856.246830:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271856.246838:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7100 00010000:02000000:1.0:1736271856.246840:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271856.246840:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024102912:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271856.246842:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024103040:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271856.246852:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024102592:12345-0@lo:400:kworker/u8:2.0 Request processed in 52us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271856.246857:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1736271856.246861:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271856.246865:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024103040:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271856.246865:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846604c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024102656:12345-0@lo:38:kworker/u8:2.0 Request processed in 36us (62us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271856.246871:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024103104:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271856.246872:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7100 00000100:00100000:3.0:1736271856.246881:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271856.246885:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:2.0:1736271856.246886:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102912 00000100:00100000:0.0:1736271856.246892:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102784 00000100:00100000:1.0:1736271856.246896:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103104 00000100:00100000:2.0:1736271856.246898:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112827 00000100:00100000:0.0:1736271856.246900:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00080000:3.0:1736271856.246900:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271856.246901:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084660e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024102912:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271856.246901:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271856.246904:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084660980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024102784:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271856.246904:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024102656:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271856.246906:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1736271856.246909:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084661300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024103104:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271856.246909:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736271856.246911:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736271856.246914:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271856.246929:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024103040:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271856.246933:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084660e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024102912:12345-0@lo:38:kworker/u8:2.0 Request processed in 32us (73us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271856.246934:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024102720:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271856.246935:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084660980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024102784:12345-0@lo:38:kworker/u8:2.0 Request processed in 31us (106us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271856.246939:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084661300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024103104:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (55us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271856.246939:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112827 00000100:00100000:3.0:1736271856.246940:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024102592:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271856.246941:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1736271856.246953:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00080000:3.0:1736271856.246964:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271856.246967:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271856.246969:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024102784:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271856.246972:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736271856.246976:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271856.246978:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271856.246980:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024102912:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271856.246986:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271856.246988:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271856.246990:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024103104:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271856.247004:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024102848:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271856.247018:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024102976 00000100:00100000:0.0:1736271856.247041:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7101 00000100:00100000:0.0:1736271856.247044:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c482f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024102976:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271856.247076:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c482f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024102976:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271856.247081:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7101 00000100:00100000:1.0:1736271856.247095:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024102976:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271856.888456:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271857.890630:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271858.892563:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271859.894481:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271859.942449:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024103168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271859.942497:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880096bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024103232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271859.942510:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271859.942561:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271859.942573:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103168 00000100:00100000:2.0:1736271859.942594:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103232 00000100:00100000:3.0:1736271859.942616:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5900 00000100:00100000:3.0:1736271859.942621:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024103168:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271859.942629:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5901 00000100:00100000:2.0:1736271859.942631:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d0e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024103232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1736271859.942644:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271859.942645:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271859.942675:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d0e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024103232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271859.942680:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024103168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271859.942681:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5901 00000100:00100000:3.0:1736271859.942686:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5900 00000100:00100000:0.0:1736271859.942694:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880096bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024103232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271859.942694:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024103168:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271860.896460:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271861.020558:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271861.020606:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271861.020631:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978496 00000100:00100000:0.0:1736271861.020642:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271861.020663:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 306 00000100:00100000:2.0:1736271861.020668:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058978496:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271861.020673:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978560 00000100:00100000:1.0:1736271861.020694:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978624 00000100:00100000:0.0:1736271861.020702:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1122 00000100:00100000:0.0:1736271861.020705:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058978560:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:3.0:1736271861.020711:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 840 00010000:02000000:0.0:1736271861.020715:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271861.020718:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058978624:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271861.020731:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058978496:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 62us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271861.020734:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058978560:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 29us (129us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271861.020738:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 306 00000100:00100000:0.0:1736271861.020740:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1122 00000100:00100000:3.0:1736271861.020752:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058978624:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271861.020758:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 840 00000100:00080000:2.0:1736271861.254436:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271861.254440:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271861.254443:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271861.254447:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8641 00000100:00080000:2.0:1736271861.254449:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271861.254452:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271861.254467:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d2140 x1820604024103360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271861.254472:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024103296:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271861.254490:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024103360:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271861.254491:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271861.254494:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271861.254494:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271861.254496:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8641 00000100:00080000:2.0:1736271861.254497:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271861.254499:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271861.254504:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d3dc0 x1820604024103488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271861.254511:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271861.254513:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271861.254514:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271861.254515:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8641 00000100:00080000:2.0:1736271861.254516:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271861.254518:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271861.254529:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0000 x1820604024103616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271861.254539:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271861.254541:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271861.254542:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271861.254544:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271861.254545:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024103552:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271861.254545:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271861.254547:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8641 00000100:00080000:2.0:1736271861.254548:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271861.254549:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271861.254553:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d4280 x1820604024103808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271861.254568:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024103488:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271861.254568:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024103424:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271861.254569:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024103744:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271861.254573:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271861.254592:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271861.254598:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271861.254604:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024103616:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271861.254607:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103296 00000100:00100000:1.0:1736271861.254608:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103360 00000100:00100000:3.0:1736271861.254610:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736271861.254614:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024103680:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271861.254617:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271861.254624:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103552 00000100:00100000:3.0:1736271861.254625:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271861.254631:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024103808:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271861.254638:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103488 00000100:00100000:2.0:1736271861.254641:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1736271861.254645:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024103296:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271861.254645:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103744 00000100:00100000:0.0:1736271861.254648:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271861.254648:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1736271861.254652:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bd84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024103552:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271861.254666:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103680 00000100:00100000:3.0:1736271861.254667:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7102 00000100:00100000:3.0:1736271861.254671:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846617c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024103744:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271861.254680:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7103 00000100:00100000:2.0:1736271861.254682:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024103296:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271861.254683:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084661c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024103680:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271861.254685:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bd84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024103552:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271861.254688:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1736271861.254690:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:3.0:1736271861.254697:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846617c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024103744:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271861.254702:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084661c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024103680:12345-0@lo:400:kworker/u8:2.0 Request processed in 19us (77us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271861.254703:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7102 00000100:00100000:0.0:1736271861.254706:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7103 00000100:00100000:1.0:1736271861.254709:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103808 00000100:00100000:2.0:1736271861.254716:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103616 00000100:00100000:1.0:1736271861.254717:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1736271861.254719:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024103360:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271861.254724:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00010000:02000000:1.0:1736271861.254727:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271861.254728:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc28e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024103488:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271861.254730:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112828 00000100:00100000:0.0:1736271861.254732:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:2.0:1736271861.254733:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc297c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024103616:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271861.254734:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271861.254735:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024103808:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271861.254739:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736271861.254739:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271861.254748:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024103360:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (210us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271861.254751:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1736271861.254757:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024103808:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (109us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271861.254757:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc28e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024103488:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (165us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271861.254760:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1736271861.254763:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1736271861.254764:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc297c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024103616:12345-0@lo:38:kworker/u8:2.0 Request processed in 30us (145us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271861.254769:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112828 00000100:00100000:1.0:1736271861.254770:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024103552:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271861.254778:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271861.254779:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271861.254781:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024103488:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271861.254786:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271861.254787:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271861.254788:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024103616:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271861.254792:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271861.254794:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271861.254795:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271861.254796:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024103808:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271861.254799:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024103680:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271861.254800:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736271861.254807:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024103744:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271861.254810:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271861.254811:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024103360:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271861.254814:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024103296:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271861.254835:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103424 00000100:00100000:3.0:1736271861.254865:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:3.0:1736271861.254868:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024103424:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271861.254912:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024103424:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271861.254918:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:2.0:1736271861.254938:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024103424:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271861.898456:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271862.900488:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271863.902537:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271864.904459:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271864.950442:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099dc84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024103872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271864.950442:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880096bd8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024103936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271864.950500:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271864.950545:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271864.950574:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103872 00000100:00100000:2.0:1736271864.950599:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024103936 00000100:00100000:3.0:1736271864.950606:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5902 00000100:00100000:3.0:1736271864.950610:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dc8980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024103872:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271864.950621:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5903 00000100:00100000:2.0:1736271864.950624:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bd8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024103936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1736271864.950630:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271864.950636:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736271864.950658:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dc8980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024103872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271864.950662:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5902 00000100:00100000:2.0:1736271864.950675:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bd8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024103936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271864.950676:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099dc84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024103872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271864.950679:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880096bd8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024103936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271864.950681:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5903 00010000:00010000:2.0:1736271865.906483:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271866.028497:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271866.028536:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271866.028562:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978688 00000100:00100000:0.0:1736271866.028568:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271866.028592:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978816 00000100:00100000:2.0:1736271866.028593:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 308 00000100:00100000:2.0:1736271866.028597:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058978688:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271866.028617:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978752 00000100:00100000:3.0:1736271866.028626:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 843 00000100:00100000:3.0:1736271866.028630:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dc84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058978816:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271866.028637:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1126 00000100:00100000:0.0:1736271866.028641:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dc8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058978752:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:2.0:1736271866.028645:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058978688:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 48us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271866.028649:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 308 00010000:02000000:0.0:1736271866.028653:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271866.028654:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dc84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058978816:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 24us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271866.028657:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 843 00000100:00100000:0.0:1736271866.028674:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dc8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058978752:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 33us (106us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271866.028679:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1126 00000100:00080000:2.0:1736271866.262447:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271866.262453:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271866.262456:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271866.262461:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8646 00000100:00080000:2.0:1736271866.262464:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271866.262468:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271866.262472:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024104000:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271866.262488:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d1300 x1820604024104064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271866.262529:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271866.262529:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271866.262531:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271866.262541:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271866.262544:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8646 00000100:00080000:2.0:1736271866.262545:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271866.262548:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271866.262552:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024104064:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271866.262555:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271866.262555:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d5f00 x1820604024104192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271866.262558:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024104128:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271866.262570:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271866.262572:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271866.262572:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271866.262574:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8646 00000100:00080000:2.0:1736271866.262575:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00100000:0.0:1736271866.262577:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271866.262577:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271866.262582:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d0000 x1820604024104320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271866.262587:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024104256:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271866.262594:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024104384:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271866.262595:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271866.262595:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104000 00000100:00080000:2.0:1736271866.262597:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271866.262598:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271866.262599:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8646 00000100:00080000:2.0:1736271866.262600:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271866.262602:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271866.262606:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800899d5a40 x1820604024104512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271866.262608:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271866.262609:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271866.262620:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024104448:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271866.262625:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104128 00000100:00100000:3.0:1736271866.262629:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1736271866.262634:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024104000:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271866.262638:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104384 00000100:00100000:0.0:1736271866.262640:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104256 00000100:00100000:2.0:1736271866.262647:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271866.262648:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1736271866.262650:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dc9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024104128:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271866.262659:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104448 00000100:00100000:1.0:1736271866.262672:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7104 00000100:00100000:1.0:1736271866.262675:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dc97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024104384:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271866.262677:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7105 00000100:00100000:3.0:1736271866.262678:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024104000:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271866.262680:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024104448:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271866.262683:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dc9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024104128:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271866.262683:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1736271866.262687:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1736271866.262695:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1736271866.262696:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bd8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024104256:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271866.262705:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024104448:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (58us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271866.262709:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7105 00000100:00100000:1.0:1736271866.262712:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dc97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024104384:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271866.262714:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bd8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024104256:12345-0@lo:400:kworker/u8:2.0 Request processed in 17us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271866.262717:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:1.0:1736271866.262717:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7104 00000100:00100000:2.0:1736271866.262732:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024104448:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271866.262736:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024104384:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271866.262737:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024104256:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271866.262739:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024104128:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271866.262745:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024104000:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271866.262755:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271866.262784:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024104192:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271866.262789:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104064 00000100:00100000:1.0:1736271866.262802:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271866.262811:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024104320:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271866.262814:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104192 00000100:00100000:3.0:1736271866.262820:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1736271866.262823:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1736271866.262824:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bd9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024104064:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271866.262826:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bd97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024104192:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271866.262828:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:0.0:1736271866.262834:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736271866.262834:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271866.262839:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024104512:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271866.262848:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104320 00000100:00100000:1.0:1736271866.262855:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271866.262858:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bd97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024104192:12345-0@lo:38:kworker/u8:2.0 Request processed in 31us (56us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271866.262859:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bd9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024104064:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (103us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271866.262863:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1736271866.262866:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:2.0:1736271866.262867:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112829 00000100:00080000:1.0:1736271866.262869:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271866.262870:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bd9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024104320:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271866.262871:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104512 00000100:00080000:1.0:1736271866.262871:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271866.262874:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024104064:0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271866.262877:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271866.262883:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:0.0:1736271866.262886:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bda140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024104512:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271866.262890:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:02000000:0.0:1736271866.262891:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736271866.262892:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271866.262894:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024104192:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271866.262898:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bd9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024104320:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (70us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736271866.262900:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271866.262902:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271866.262903:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112829 00000100:00100000:1.0:1736271866.262904:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024104320:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271866.262911:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bda140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024104512:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (56us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736271866.262911:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271866.262913:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271866.262915:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024104512:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271866.262916:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00010000:00010000:2.0:1736271866.908456:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271867.910491:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271868.912478:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271869.914393:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271869.958441:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880096bda600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024104640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271869.958460:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099dc9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024104576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271869.958498:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271869.958525:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271869.958543:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104640 00000100:00100000:2.0:1736271869.958583:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104576 00000100:00100000:2.0:1736271869.958607:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5904 00000100:00100000:2.0:1736271869.958612:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bdaac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024104640:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271869.958616:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5905 00000100:00100000:3.0:1736271869.958620:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084662140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024104576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271869.958635:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:3.0:1736271869.958635:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271869.958666:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084662140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024104576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271869.958671:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5905 00000100:00100000:2.0:1736271869.958678:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bdaac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024104640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271869.958684:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5904 00000100:00100000:0.0:1736271869.958696:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099dc9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024104576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271869.958719:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880096bda600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024104640:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271870.916479:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271871.036510:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271871.036558:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271871.036589:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978880 00000100:00100000:0.0:1736271871.036614:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271871.036638:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 310 00000100:00100000:3.0:1736271871.036643:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058978880:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271871.036686:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979008 00000100:00100000:3.0:1736271871.036694:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058978880:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 51us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271871.036695:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058978944 00000100:00100000:3.0:1736271871.036700:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 310 00000100:00100000:1.0:1736271871.036713:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 846 00000100:00100000:1.0:1736271871.036717:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dc9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058979008:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271871.036722:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1130 00000100:00100000:2.0:1736271871.036732:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dca140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058978944:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:2.0:1736271871.036743:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271871.036745:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dc9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058979008:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 27us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271871.036751:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 846 00000100:00100000:2.0:1736271871.036770:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dca140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058978944:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 37us (156us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271871.036775:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1130 00000100:00080000:2.0:1736271871.270441:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271871.270447:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271871.270450:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271871.270455:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8651 00000100:00080000:2.0:1736271871.270459:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271871.270463:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271871.270481:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c138980 x1820604024104768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271871.270487:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736271871.270503:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024104704:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271871.270521:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271871.270524:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271871.270525:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271871.270528:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8651 00000100:00080000:2.0:1736271871.270530:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271871.270533:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271871.270542:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c139300 x1820604024104896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271871.270554:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271871.270557:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271871.270558:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271871.270560:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8651 00000100:00100000:0.0:1736271871.270562:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1397c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024104960:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271871.270562:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024104832:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271871.270568:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271871.270573:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271871.270575:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271871.270584:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c139c80 x1820604024105024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271871.270598:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024104768:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271871.270599:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271871.270603:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1736271871.270605:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271871.270608:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271871.270609:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736271871.270611:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024105152:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271871.270612:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8651 00000100:00080000:2.0:1736271871.270613:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271871.270615:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271871.270620:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271871.270622:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13aac0 x1820604024105216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271871.270631:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024104896:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271871.270632:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271871.270638:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104704 00000100:00100000:2.0:1736271871.270643:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104832 00000100:00100000:1.0:1736271871.270650:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271871.270651:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024105088:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271871.270657:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c139c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024105024:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271871.270661:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1736271871.270664:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104768 00000100:00100000:1.0:1736271871.270669:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271871.270671:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024104704:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271871.270673:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271871.270674:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104896 00000100:00100000:2.0:1736271871.270685:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:2.0:1736271871.270689:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084662600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024104832:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271871.270690:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024105216:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271871.270695:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105152 00000100:00100000:1.0:1736271871.270700:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271871.270704:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024104704:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271871.270710:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1736271871.270714:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105088 00000100:00100000:1.0:1736271871.270714:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105216 00000100:00100000:1.0:1736271871.270723:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1736271871.270724:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084662600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024104832:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271871.270725:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7106 00000100:00100000:1.0:1736271871.270726:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bda600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024104768:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271871.270729:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:0.0:1736271871.270734:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dca600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024105152:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:1.0:1736271871.270734:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271871.270738:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1736271871.270741:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1736271871.270742:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bdaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024104896:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271871.270744:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bdb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024105216:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271871.270749:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736271871.270750:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271871.270752:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bda600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024104768:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (132us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271871.270755:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:0.0:1736271871.270763:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dca600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024105152:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271871.270768:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7106 00000100:00100000:2.0:1736271871.270769:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bdb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024105216:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (69us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271871.270772:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7107 00000100:00100000:2.0:1736271871.270774:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:1.0:1736271871.270775:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dcaac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024105088:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271871.270779:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bdaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024104896:12345-0@lo:38:kworker/u8:2.0 Request processed in 37us (127us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271871.270785:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271871.270787:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1736271871.270793:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dcaac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024105088:12345-0@lo:400:kworker/u8:2.0 Request processed in 18us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271871.270795:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024104960 00000100:00100000:1.0:1736271871.270796:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7107 00000100:00100000:1.0:1736271871.270807:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:1.0:1736271871.270809:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024104960:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271871.270816:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024105152:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271871.270816:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024104832:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271871.270819:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105024 00000100:00100000:1.0:1736271871.270821:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024104960:12345-0@lo:400:kworker/u8:2.0 Request processed in 11us (36us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271871.270824:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:0.0:1736271871.270825:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024105088:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271871.270831:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112830 00000100:00100000:2.0:1736271871.270834:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bdb440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024105024:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271871.270841:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271871.270843:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c1397c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024104960:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271871.270860:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bdb440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024105024:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (191us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271871.270865:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112830 00000100:00080000:0.0:1736271871.271336:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271871.271338:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271871.271340:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024105216:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271871.271345:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271871.271346:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271871.271348:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024104768:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271871.271357:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271871.271359:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271871.271360:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024104896:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271871.271364:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271871.271365:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271871.271366:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c139c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024105024:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271871.271391:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024104704:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271871.918501:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271872.920511:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271873.922495:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271874.924446:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271874.966534:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099dcaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024105344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271874.966593:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271874.966609:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880096bd84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024105280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271874.966662:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271874.966740:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105344 00000100:00100000:2.0:1736271874.966751:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105280 00000100:00100000:0.0:1736271874.966782:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5906 00000100:00100000:0.0:1736271874.966787:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bd8980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024105344:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271874.966787:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5907 00000100:00100000:2.0:1736271874.966791:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084662ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024105280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271874.966810:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:0.0:1736271874.966813:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271874.966852:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bd8980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024105344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271874.966858:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5906 00000100:00100000:2.0:1736271874.966863:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084662ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024105280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271874.966868:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5907 00000100:00100000:1.0:1736271874.966880:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099dcaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024105344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271874.966910:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880096bd84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024105280:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271875.926483:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271876.044549:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271876.044586:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271876.044625:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271876.044633:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979072 00000100:00100000:0.0:1736271876.044658:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979200 00000100:00100000:3.0:1736271876.044676:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979136 00000100:00100000:2.0:1736271876.044679:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 312 00000100:00100000:2.0:1736271876.044684:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058979072:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271876.044695:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 849 00000100:00100000:0.0:1736271876.044699:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dcb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058979200:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271876.044719:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1134 00000100:00100000:3.0:1736271876.044723:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dcb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058979136:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736271876.044734:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271876.044747:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058979072:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 62us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271876.044749:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dcb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058979200:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271876.044754:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 312 00000100:00100000:0.0:1736271876.044755:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 849 00000100:00100000:3.0:1736271876.044775:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dcb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058979136:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 51us (149us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271876.044779:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1134 00000100:00080000:2.0:1736271876.278410:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271876.278416:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271876.278419:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271876.278424:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8656 00000100:00100000:0.0:1736271876.278433:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024105408:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271876.278440:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271876.278445:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271876.278464:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13b440 x1820604024105472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271876.278486:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271876.278489:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271876.278489:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271876.278491:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024105472:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271876.278492:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8656 00000100:00080000:2.0:1736271876.278493:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271876.278495:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271876.278501:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13bdc0 x1820604024105600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271876.278502:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271876.278532:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271876.278534:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271876.278534:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271876.278536:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8656 00000100:00080000:2.0:1736271876.278537:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271876.278540:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271876.278546:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13c740 x1820604024105728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271876.278549:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271876.278552:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271876.278559:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024105536:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271876.278559:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271876.278561:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271876.278562:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271876.278564:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8656 00000100:00080000:2.0:1736271876.278565:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:3.0:1736271876.278568:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024105664:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271876.278571:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271876.278573:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024105600:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271876.278578:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13d580 x1820604024105920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271876.278582:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271876.278595:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736271876.278597:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024105792:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271876.278600:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024105856:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271876.278601:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271876.278624:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271876.278627:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105472 00000100:00100000:3.0:1736271876.278639:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105408 00000100:00100000:2.0:1736271876.278642:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105856 00000100:00100000:0.0:1736271876.278644:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105536 00000100:00100000:1.0:1736271876.278652:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105664 00000100:00100000:3.0:1736271876.278657:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1736271876.278659:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:3.0:1736271876.278660:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024105408:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271876.278661:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dcbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024105536:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271876.278673:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1736271876.278674:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7108 00000100:00100000:1.0:1736271876.278676:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084662f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024105664:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271876.278678:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bd9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024105856:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271876.278691:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dcbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024105536:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271876.278691:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024105408:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271876.278695:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:3.0:1736271876.278696:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1736271876.278707:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1736271876.278709:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bd97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024105472:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271876.278722:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084662f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024105664:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271876.278722:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bd9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024105856:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (96us total) trans 0 rc 0/0 00010000:02000000:0.0:1736271876.278726:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271876.278728:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7108 00000100:00100000:1.0:1736271876.278735:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1736271876.278738:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024105536:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271876.278746:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024105408:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271876.278749:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271876.278753:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bd97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024105472:12345-0@lo:38:kworker/u8:2.0 Request processed in 42us (203us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271876.278759:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:1.0:1736271876.278759:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105792 00000100:00100000:3.0:1736271876.278773:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024105664:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271876.278775:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7109 00000100:00100000:1.0:1736271876.278777:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024105792:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271876.278784:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024105856:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271876.278800:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024105792:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (51us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271876.278803:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7109 00000100:00100000:1.0:1736271876.278814:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271876.278822:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024105792:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271876.278823:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024105728:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271876.278832:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105600 00000100:00100000:1.0:1736271876.278837:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271876.278847:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:2.0:1736271876.278849:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bda140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024105600:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271876.278857:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736271876.278860:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271876.278862:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271876.278865:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024105472:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271876.278874:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024105920:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271876.278876:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bda140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024105600:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (61us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271876.278879:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1736271876.278884:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105728 00000100:00100000:1.0:1736271876.278886:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736271876.278898:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271876.278899:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271876.278899:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105920 00000100:00100000:1.0:1736271876.278901:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024105600:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271876.278903:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112831 00000100:00100000:3.0:1736271876.278906:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bdbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024105728:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271876.278912:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271876.278913:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:2.0:1736271876.278915:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bdc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024105920:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271876.278918:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271876.278944:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bdbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024105728:12345-0@lo:38:kworker/u8:2.0 Request processed in 38us (107us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736271876.278948:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736271876.278948:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112831 00000100:00080000:1.0:1736271876.278949:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271876.278951:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024105920:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271876.278951:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bdc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024105920:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (63us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736271876.278956:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271876.278956:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00080000:1.0:1736271876.278957:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271876.278963:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024105728:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271876.928434:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271877.930464:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271878.932447:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271879.934449:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271879.974460:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880096bdc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024105984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271879.974521:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271879.974548:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099dcc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024106048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271879.974565:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271879.974582:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024105984 00000100:00100000:2.0:1736271879.974605:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106048 00000100:00100000:0.0:1736271879.974614:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5908 00000100:00100000:0.0:1736271879.974617:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bdcc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024105984:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271879.974620:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5909 00000100:00100000:1.0:1736271879.974623:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bdd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024106048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271879.974638:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:1.0:1736271879.974638:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736271879.974659:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bdd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024106048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271879.974663:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5909 00000100:00100000:0.0:1736271879.974666:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bdcc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024105984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271879.974669:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5908 00000100:00100000:2.0:1736271879.974681:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880096bdc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024105984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271879.974688:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099dcc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024106048:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271880.936494:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271881.052480:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271881.052545:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271881.052576:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271881.052596:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979392 00000100:00100000:2.0:1736271881.052596:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979264 00000100:00100000:0.0:1736271881.052631:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 852 00000100:00100000:1.0:1736271881.052632:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979328 00000100:00100000:0.0:1736271881.052636:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dcc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058979392:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271881.052644:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 314 00000100:00100000:2.0:1736271881.052648:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058979264:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271881.052673:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1138 00000100:00100000:1.0:1736271881.052678:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dccc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058979328:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271881.052690:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271881.052691:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dcc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058979392:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 55us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271881.052692:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058979264:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 43us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271881.052696:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 852 00000100:00100000:2.0:1736271881.052699:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 314 00000100:00100000:1.0:1736271881.052735:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dccc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058979328:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 56us (158us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271881.052743:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1138 00000100:00080000:2.0:1736271881.286451:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271881.286459:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271881.286462:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271881.286469:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8661 00000100:00080000:2.0:1736271881.286475:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271881.286480:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271881.286493:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736271881.286504:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13df00 x1820604024106176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271881.286514:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024106112:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271881.286545:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271881.286549:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271881.286550:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271881.286553:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8661 00000100:00080000:2.0:1736271881.286555:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271881.286558:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271881.286566:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271881.286573:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271881.286580:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13e880 x1820604024106304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271881.286589:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024106240:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271881.286592:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024106176:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271881.286601:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271881.286605:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271881.286606:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271881.286609:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8661 00000100:00080000:2.0:1736271881.286610:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736271881.286614:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271881.286617:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024106368:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271881.286623:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13f200 x1820604024106432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271881.286628:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271881.286636:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024106496:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271881.286661:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271881.286665:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1736271881.286665:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106112 00000100:00080000:2.0:1736271881.286666:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271881.286669:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8661 00000100:00080000:2.0:1736271881.286670:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:0.0:1736271881.286671:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271881.286671:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024106304:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271881.286673:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271881.286683:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13d580 x1820604024106624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271881.286686:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271881.286701:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1736271881.286706:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106176 00000100:00100000:3.0:1736271881.286706:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024106112:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271881.286708:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106496 00000100:00100000:0.0:1736271881.286709:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106368 00000100:00100000:2.0:1736271881.286736:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7110 00000100:00100000:1.0:1736271881.286739:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:2.0:1736271881.286741:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dcd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024106496:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271881.286743:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1736271881.286744:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dcd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024106368:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271881.286747:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bdd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024106176:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271881.286749:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024106112:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271881.286755:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:02000000:0.0:1736271881.286759:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271881.286785:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dcd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024106368:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271881.286788:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dcd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024106496:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271881.286792:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:0.0:1736271881.286793:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bdd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024106176:12345-0@lo:38:kworker/u8:2.0 Request processed in 45us (165us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271881.286794:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7110 00000100:00100000:0.0:1736271881.286798:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1736271881.286809:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271881.286823:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106240 00000100:00100000:2.0:1736271881.286829:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024106112:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271881.286835:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024106560:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271881.286840:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1736271881.286843:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024106496:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271881.286844:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084663440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024106240:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271881.286854:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271881.286870:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024106368:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271881.286872:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106560 00000100:00100000:1.0:1736271881.286876:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084663440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024106240:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (67us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271881.286881:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024106240:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271881.286882:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:1.0:1736271881.286899:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271881.286908:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7111 00000100:00100000:2.0:1736271881.286913:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084663900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024106560:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271881.286921:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024106432:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271881.286940:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106304 00000100:00100000:1.0:1736271881.286946:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271881.286947:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084663900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024106560:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271881.286952:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024106560:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271881.286953:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7111 00000100:00100000:0.0:1736271881.286963:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00080000:1.0:1736271881.286966:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271881.286967:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024106304:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271881.286968:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271881.286968:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106432 00000100:00100000:1.0:1736271881.286971:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024106176:0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271881.286973:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271881.286984:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024106624:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271881.286986:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112832 00000100:00100000:3.0:1736271881.286990:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bddf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024106432:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271881.286998:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024106304:12345-0@lo:38:kworker/u8:2.0 Request processed in 30us (98us total) trans 0 rc -19/-19 00010000:02000000:3.0:1736271881.287000:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271881.287003:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1736271881.287005:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271881.287024:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106624 00000100:00080000:1.0:1736271881.287030:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736271881.287030:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bddf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024106432:12345-0@lo:38:kworker/u8:2.0 Request processed in 39us (84us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736271881.287033:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271881.287036:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:1.0:1736271881.287037:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024106304:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271881.287037:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112832 00000100:00100000:0.0:1736271881.287039:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bde3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024106624:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271881.287045:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736271881.287046:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271881.287048:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271881.287051:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024106432:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271881.287065:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bde3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024106624:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (60us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271881.287069:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00080000:1.0:1736271881.287075:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271881.287077:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271881.287079:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024106624:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271881.938491:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271882.940476:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271883.942462:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271884.944492:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271884.982469:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271884.982486:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099dcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024106752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271884.982548:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271884.982562:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271884.982572:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024106688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271884.982597:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271884.982599:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106752 00000100:00100000:2.0:1736271884.982626:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106688 00000100:00100000:0.0:1736271884.982631:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5910 00000100:00100000:0.0:1736271884.982636:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024106752:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271884.982642:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5911 00000100:00100000:2.0:1736271884.982645:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dcdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024106688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271884.982662:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271884.982662:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271884.982692:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024106752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271884.982698:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5910 00000100:00100000:2.0:1736271884.982700:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dcdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024106688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271884.982706:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5911 00000100:00100000:2.0:1736271884.982739:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099dcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024106752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271884.982740:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024106688:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271885.946433:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271886.060560:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271886.060595:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271886.060623:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271886.060635:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979456 00000100:00100000:0.0:1736271886.060641:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979584 00000100:00100000:1.0:1736271886.060661:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979520 00000100:00100000:3.0:1736271886.060668:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 316 00000100:00100000:0.0:1736271886.060671:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 855 00000100:00100000:3.0:1736271886.060673:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058979456:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271886.060682:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dce3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058979584:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271886.060693:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1142 00000100:00100000:1.0:1736271886.060698:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dce880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058979520:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271886.060709:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271886.060718:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dce3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058979584:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 36us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271886.060720:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058979456:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 46us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271886.060723:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 855 00000100:00100000:3.0:1736271886.060726:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 316 00000100:00100000:1.0:1736271886.060733:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dce880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058979520:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 35us (109us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271886.060739:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1142 00000100:00080000:2.0:1736271886.294446:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271886.294452:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271886.294455:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271886.294462:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8666 00000100:00080000:2.0:1736271886.294465:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271886.294470:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271886.294483:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024106816:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271886.294499:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13cc00 x1820604024106880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271886.294541:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736271886.294542:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024106880:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271886.294544:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271886.294544:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271886.294545:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271886.294548:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8666 00000100:00080000:2.0:1736271886.294549:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271886.294553:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271886.294561:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13af80 x1820604024107008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271886.294569:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271886.294572:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271886.294575:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271886.294576:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271886.294578:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8666 00000100:00080000:2.0:1736271886.294579:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271886.294581:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271886.294583:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106816 00000100:00100000:3.0:1736271886.294585:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024107072:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271886.294587:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c1384c0 x1820604024107136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271886.294588:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024107008:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271886.294600:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271886.294605:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00080000:2.0:1736271886.294607:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271886.294608:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024106816:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271886.294610:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024107136:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271886.294610:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271886.294611:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271886.294611:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271886.294613:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8666 00000100:00080000:2.0:1736271886.294614:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271886.294616:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271886.294625:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c138980 x1820604024107328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271886.294628:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271886.294632:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736271886.294635:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024106816:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271886.294637:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024106944:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271886.294639:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1736271886.294652:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106880 00000100:00100000:3.0:1736271886.294656:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271886.294657:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024107328:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271886.294669:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107008 00000100:00100000:2.0:1736271886.294670:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107072 00000100:00100000:0.0:1736271886.294676:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271886.294681:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024106944 00000100:00100000:1.0:1736271886.294684:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1736271886.294688:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084663dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024107072:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271886.294688:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107328 00000100:00100000:2.0:1736271886.294691:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:2.0:1736271886.294695:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084664280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024106944:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271886.294708:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:0.0:1736271886.294711:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dced40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024106880:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271886.294717:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:3.0:1736271886.294720:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dcf200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024107008:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271886.294722:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271886.294725:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084664280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024106944:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271886.294727:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084663dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024107072:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (115us total) trans 0 rc 0/0 00010000:02000000:3.0:1736271886.294727:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271886.294729:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:1.0:1736271886.294732:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:2.0:1736271886.294737:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1736271886.294739:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024107328:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271886.294743:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271886.294750:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dced40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024106880:12345-0@lo:38:kworker/u8:2.0 Request processed in 38us (181us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271886.294751:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dcf200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024107008:12345-0@lo:38:kworker/u8:2.0 Request processed in 30us (149us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271886.294752:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024107264:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271886.294754:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024107328:12345-0@lo:38:kworker/u8:2.0 Request processed in 15us (79us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271886.294755:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1736271886.294758:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:2.0:1736271886.294765:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1736271886.294773:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107136 00000100:00100000:1.0:1736271886.294773:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271886.294786:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107264 00000100:00100000:0.0:1736271886.294787:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112833 00000100:00100000:3.0:1736271886.294788:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024106944:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271886.294790:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dcf6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024107136:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271886.294791:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024106816:0@lo:400:kworker/u8:2.0 00010000:02000000:0.0:1736271886.294796:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271886.294798:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024107072:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271886.294799:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7112 00000100:00100000:2.0:1736271886.294801:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bde880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024107264:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271886.294802:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736271886.294807:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c139c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024107200:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271886.294819:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dcf6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024107136:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (190us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271886.294819:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bde880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024107264:12345-0@lo:400:kworker/u8:2.0 Request processed in 18us (47us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271886.294822:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7112 00000100:00100000:0.0:1736271886.294824:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112833 00000100:00100000:1.0:1736271886.294826:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271886.294842:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024107264:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271886.294844:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107200 00000100:00080000:0.0:1736271886.294856:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271886.294857:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7113 00000100:00080000:0.0:1736271886.294858:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271886.294859:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bded40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024107200:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271886.294861:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024107328:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271886.294869:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271886.294871:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271886.294873:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024107136:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271886.294879:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271886.294881:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271886.294882:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024107008:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271886.294888:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271886.294890:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271886.294891:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bded40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024107200:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (65us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271886.294892:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024106880:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271886.294894:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7113 00000100:00100000:1.0:1736271886.294908:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c139c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024107200:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271886.948487:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271887.950918:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271888.952452:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271889.954482:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271889.990457:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024107392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271889.990519:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271889.990556:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736271889.990561:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880096bdf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024107456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271889.990581:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107392 00000100:00100000:3.0:1736271889.990581:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271889.990607:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107456 00000100:00100000:2.0:1736271889.990617:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5912 00000100:00100000:2.0:1736271889.990620:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084664740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024107392:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271889.990630:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5913 00000100:00100000:0.0:1736271889.990634:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084664c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024107456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271889.990640:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:0.0:1736271889.990648:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271889.990672:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084664740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024107392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271889.990676:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5912 00000100:00100000:0.0:1736271889.990682:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084664c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024107456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271889.990688:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5913 00000100:00100000:3.0:1736271889.990709:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880096bdf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024107456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271889.990720:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024107392:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271890.956467:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271891.068587:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271891.068638:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271891.068677:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979648 00000100:00100000:0.0:1736271891.068685:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271891.068719:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 318 00000100:00100000:1.0:1736271891.068723:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058979648:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271891.068742:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979776 00000100:00100000:3.0:1736271891.068745:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979712 00000100:00100000:1.0:1736271891.068780:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058979648:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 56us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271891.068785:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 318 00000100:00100000:3.0:1736271891.068787:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 858 00000100:00100000:2.0:1736271891.068793:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1146 00000100:00100000:3.0:1736271891.068794:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dcc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058979776:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271891.068797:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dcaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058979712:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:2.0:1736271891.068810:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271891.068846:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dcaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058979712:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 48us (162us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271891.068847:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dcc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058979776:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 54us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271891.068852:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1146 00000100:00100000:3.0:1736271891.068865:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 858 00000100:00080000:2.0:1736271891.302462:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271891.302470:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271891.302474:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271891.302481:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8671 00000100:00080000:2.0:1736271891.302485:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271891.302491:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271891.302505:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1397c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024107520:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271891.302516:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13a140 x1820604024107584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271891.302540:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024107584:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271891.302540:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271891.302543:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271891.302556:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271891.302560:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8671 00000100:00080000:2.0:1736271891.302562:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271891.302566:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271891.302570:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271891.302575:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c138e40 x1820604024107712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271891.302582:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271891.302607:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736271891.302609:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1736271891.302611:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271891.302612:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736271891.302615:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024107648:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271891.302615:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8671 00000100:00100000:1.0:1736271891.302616:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024107712:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271891.302617:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271891.302620:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271891.302628:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c139c80 x1820604024107840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271891.302636:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271891.302650:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271891.302652:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271891.302653:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024107968:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271891.302654:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271891.302655:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271891.302660:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8671 00000100:00080000:2.0:1736271891.302662:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271891.302664:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271891.302673:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271891.302673:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c1384c0 x1820604024108032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271891.302677:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c139c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024107840:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271891.302694:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024107904:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271891.302699:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271891.302708:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107520 00000100:00100000:1.0:1736271891.302713:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024108032:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271891.302721:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271891.302731:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271891.302740:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1736271891.302741:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271891.302744:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024107520:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271891.302744:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107584 00000100:00100000:2.0:1736271891.302745:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024107776:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271891.302758:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107648 00000100:00100000:2.0:1736271891.302770:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271891.302775:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024107520:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271891.302779:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1736271891.302791:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107712 00000100:00100000:1.0:1736271891.302795:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108032 00000100:00100000:0.0:1736271891.302801:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107968 00000100:00100000:1.0:1736271891.302805:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107776 00000100:00100000:2.0:1736271891.302813:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:0.0:1736271891.302815:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107904 00000100:00100000:2.0:1736271891.302819:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024107648:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271891.302822:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7114 00000100:00100000:1.0:1736271891.302822:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:0.0:1736271891.302825:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dc84c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024107968:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271891.302826:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c139300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024107776:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271891.302829:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:3.0:1736271891.302834:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bdf6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024107584:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271891.302850:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024107648:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (213us total) trans 0 rc 0/0 00010000:02000000:3.0:1736271891.302850:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271891.302853:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dc84c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024107968:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271891.302855:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:0.0:1736271891.302858:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7114 00000100:00100000:1.0:1736271891.302860:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c139300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024107776:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271891.302867:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7115 00000100:00100000:1.0:1736271891.302867:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:0.0:1736271891.302870:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c138980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024107904:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271891.302871:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1736271891.302874:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bd84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024108032:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271891.302877:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1736271891.302880:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bdf200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024107712:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271891.302883:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736271891.302886:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271891.302896:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c138980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024107904:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271891.302900:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7115 00000100:00100000:3.0:1736271891.302913:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bdf6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024107584:12345-0@lo:38:kworker/u8:2.0 Request processed in 78us (330us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271891.302914:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bdf200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024107712:12345-0@lo:38:kworker/u8:2.0 Request processed in 32us (261us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271891.302914:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bd84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024108032:12345-0@lo:38:kworker/u8:2.0 Request processed in 37us (181us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271891.302917:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024107840 00000100:00100000:3.0:1736271891.302920:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1736271891.302930:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112834 00000100:00100000:0.0:1736271891.302932:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bdc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024107840:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271891.302934:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1736271891.302937:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00010000:02000000:0.0:1736271891.302941:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271891.302966:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bdc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024107840:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (268us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736271891.302966:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271891.302967:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024107776:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271891.302969:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271891.302971:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112834 00000100:00100000:1.0:1736271891.302972:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024108032:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271891.302977:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024107904:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271891.302979:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271891.302980:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271891.302982:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c139c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024107840:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271891.302989:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271891.302991:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024107968:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271891.302995:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271891.302997:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024107648:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271891.302997:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024107712:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271891.303005:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c1397c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024107520:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271891.303006:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271891.303007:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271891.303009:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024107584:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271891.958454:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271892.960464:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271893.962461:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271894.964456:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271894.998447:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736271894.998448:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271894.998462:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024108096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271894.998462:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880096bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024108160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271894.998516:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271894.998545:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271894.998556:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108096 00000100:00100000:0.0:1736271894.998569:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108160 00000100:00100000:2.0:1736271894.998594:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5914 00000100:00100000:0.0:1736271894.998598:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5915 00000100:00100000:2.0:1736271894.998598:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dc8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024108096:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271894.998601:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846650c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024108160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271894.998618:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271894.998619:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271894.998648:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846650c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024108160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271894.998650:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dc8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024108096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271894.998652:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5915 00000100:00100000:2.0:1736271894.998656:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5914 00000100:00100000:3.0:1736271894.998671:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880096bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024108160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271894.998672:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024108096:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271895.966575:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271896.076479:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271896.076512:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271896.076546:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979840 00000100:00100000:0.0:1736271896.076547:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271896.076577:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979968 00000100:00100000:2.0:1736271896.076580:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 320 00000100:00100000:2.0:1736271896.076586:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008faa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058979840:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271896.076620:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058979904 00000100:00100000:3.0:1736271896.076623:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 861 00000100:00100000:3.0:1736271896.076629:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dc9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058979968:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271896.076633:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008faa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058979840:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 47us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271896.076637:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1150 00000100:00100000:2.0:1736271896.076638:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 320 00000100:00100000:1.0:1736271896.076642:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dc9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058979904:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271896.076654:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271896.076662:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dc9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058979968:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 33us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271896.076668:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 861 00000100:00100000:1.0:1736271896.076686:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dc9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058979904:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 44us (139us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271896.076692:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1150 00000100:00080000:2.0:1736271896.310432:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271896.310438:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271896.310440:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271896.310446:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8676 00000100:00080000:2.0:1736271896.310450:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271896.310455:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271896.310456:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024108224:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271896.310473:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13b900 x1820604024108288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271896.310518:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271896.310519:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271896.310523:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271896.310524:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271896.310527:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8676 00000100:00080000:2.0:1736271896.310528:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271896.310531:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271896.310537:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024108352:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271896.310539:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13b440 x1820604024108416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271896.310544:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024108288:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271896.310548:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271896.310549:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271896.310550:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271896.310561:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8676 00000100:00100000:0.0:1736271896.310562:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271896.310562:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271896.310564:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271896.310570:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13d580 x1820604024108544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271896.310571:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108224 00000100:00100000:1.0:1736271896.310574:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024108480:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271896.310585:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271896.310586:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271896.310587:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271896.310589:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8676 00000100:00080000:2.0:1736271896.310590:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271896.310591:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271896.310592:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271896.310595:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108352 00000100:00100000:2.0:1736271896.310595:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13df00 x1820604024108736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271896.310600:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1736271896.310604:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008faab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024108224:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271896.310608:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024108608:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271896.310616:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108480 00000100:00100000:1.0:1736271896.310617:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271896.310628:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108288 00000100:00100000:1.0:1736271896.310631:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024108416:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271896.310631:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271896.310638:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008faab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024108224:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271896.310645:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1736271896.310649:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1736271896.310653:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099dca140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024108352:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271896.310655:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271896.310656:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271896.310660:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024108672:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271896.310663:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024108544:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271896.310671:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108416 00000100:00100000:3.0:1736271896.310681:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1736271896.310683:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271896.310685:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880096bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024108480:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271896.310686:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271896.310690:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099dca140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024108352:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271896.310696:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:1.0:1736271896.310704:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024108736:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271896.310705:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108608 00000100:00100000:0.0:1736271896.310708:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:0.0:1736271896.310710:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9ebdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024108288:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271896.310718:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271896.310722:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271896.310722:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880096bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024108480:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271896.310726:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108672 00000100:00100000:3.0:1736271896.310728:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1736271896.310738:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7116 00000100:00100000:3.0:1736271896.310739:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108736 00000100:00100000:1.0:1736271896.310741:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1736271896.310742:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024108608:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271896.310743:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9ebdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024108288:12345-0@lo:38:kworker/u8:2.0 Request processed in 32us (126us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271896.310745:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024108416:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271896.310748:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00010000:02000000:1.0:1736271896.310751:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271896.310751:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1736271896.310762:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9eb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024108736:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271896.310768:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271896.310774:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024108416:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (117us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271896.310774:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024108608:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271896.310778:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024108352:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271896.310779:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1736271896.310779:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7116 00000100:00100000:3.0:1736271896.310788:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9eb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024108736:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (66us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271896.310789:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7117 00000100:00100000:3.0:1736271896.310793:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1736271896.310798:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108544 00000100:00100000:2.0:1736271896.310798:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024108672:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271896.310813:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112835 00000100:00100000:3.0:1736271896.310816:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024108480:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271896.310817:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9ed580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024108544:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271896.310822:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024108672:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (139us total) trans 0 rc 0/0 00010000:02000000:1.0:1736271896.310823:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271896.310827:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7117 00000100:00100000:3.0:1736271896.310834:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024108224:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271896.310839:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9ed580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024108544:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (153us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271896.310844:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112835 00000100:00100000:2.0:1736271896.310850:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024108672:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271896.310858:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024108608:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271896.310861:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271896.310863:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271896.310865:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024108416:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271896.310872:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271896.310873:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271896.310875:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024108544:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271896.310881:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271896.310883:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271896.310885:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024108736:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271896.310890:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271896.310896:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271896.310898:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024108288:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271896.968435:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271897.970439:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271898.972451:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271899.974468:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271900.006467:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024108800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271900.006467:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009351b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024108864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271900.006526:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271900.006554:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271900.006587:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108800 00000100:00100000:0.0:1736271900.006610:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108864 00000100:00100000:2.0:1736271900.006617:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5916 00000100:00100000:2.0:1736271900.006621:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024108800:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271900.006630:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5917 00000100:00100000:1.0:1736271900.006634:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084665580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024108864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271900.006646:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:1.0:1736271900.006650:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271900.006678:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024108800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271900.006683:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5916 00000100:00100000:1.0:1736271900.006686:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084665580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024108864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271900.006692:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5917 00000100:00100000:0.0:1736271900.006703:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024108800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271900.006711:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009351b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024108864:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271900.976460:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271901.084509:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271901.084535:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271901.084573:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980160 00000100:00100000:0.0:1736271901.084574:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271901.084597:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980096 00000100:00100000:2.0:1736271901.084617:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 864 00000100:00100000:2.0:1736271901.084622:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935197c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058980160:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271901.084624:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1154 00000100:00100000:3.0:1736271901.084628:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058980096:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736271901.084641:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271901.084644:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980032 00000100:00100000:1.0:1736271901.084670:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 322 00000100:00100000:1.0:1736271901.084674:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008faae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058980032:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271901.084682:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935197c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058980160:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 60us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271901.084686:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 864 00000100:00100000:3.0:1736271901.084688:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058980096:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 59us (152us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271901.084695:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1154 00000100:00100000:1.0:1736271901.084700:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008faae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058980032:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 25us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271901.084706:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 322 00000100:00080000:2.0:1736271901.318405:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271901.318410:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271901.318412:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271901.318416:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8681 00000100:00080000:2.0:1736271901.318427:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271901.318431:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271901.318447:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024108928:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271901.318447:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13ed40 x1820604024108992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271901.318484:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271901.318487:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271901.318488:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271901.318491:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8681 00000100:00080000:2.0:1736271901.318492:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271901.318496:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271901.318501:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271901.318503:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024109056:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271901.318505:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13f200 x1820604024109120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271901.318511:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024108992:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271901.318523:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271901.318526:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271901.318527:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271901.318530:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8681 00000100:00080000:2.0:1736271901.318531:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271901.318534:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271901.318541:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024109184:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271901.318541:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271901.318542:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13df00 x1820604024109248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271901.318561:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271901.318563:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271901.318564:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024109120:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271901.318564:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271901.318564:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108928 00000100:00100000:0.0:1736271901.318565:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271901.318567:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8681 00000100:00080000:2.0:1736271901.318568:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271901.318575:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271901.318577:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271901.318581:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024109312:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271901.318582:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271901.318584:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13aac0 x1820604024109440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271901.318593:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024109248:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271901.318594:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1736271901.318595:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271901.318599:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008faae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024108928:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271901.318602:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024108992 00000100:00100000:0.0:1736271901.318610:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109184 00000100:00100000:1.0:1736271901.318610:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271901.318615:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109120 00000100:00100000:2.0:1736271901.318625:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:2.0:1736271901.318627:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9eaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024108992:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271901.318631:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008faae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024108928:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271901.318632:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024109440:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271901.318633:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00010000:02000000:2.0:1736271901.318635:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271901.318636:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024109184:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271901.318637:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1736271901.318645:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271901.318659:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024109184:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271901.318661:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109248 00000100:00100000:3.0:1736271901.318661:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109312 00000100:00100000:0.0:1736271901.318662:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:2.0:1736271901.318663:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9eaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024108992:12345-0@lo:38:kworker/u8:2.0 Request processed in 35us (123us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271901.318667:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1736271901.318668:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109440 00000100:00100000:0.0:1736271901.318674:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1736271901.318674:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112836 00000100:00100000:0.0:1736271901.318676:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9ec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024109120:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271901.318677:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb12f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024109248:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271901.318677:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7118 00000100:00100000:3.0:1736271901.318680:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024109312:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:0.0:1736271901.318681:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271901.318681:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00010000:02000000:1.0:1736271901.318683:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271901.318683:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024109440:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271901.318686:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271901.318694:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9ec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024109120:12345-0@lo:38:kworker/u8:2.0 Request processed in 17us (113us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271901.318697:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1736271901.318700:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb12f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024109248:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (90us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271901.318701:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024109440:12345-0@lo:38:kworker/u8:2.0 Request processed in 17us (56us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271901.318704:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:1.0:1736271901.318705:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112836 00000100:00100000:3.0:1736271901.318705:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024109312:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271901.318710:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7118 00000100:00080000:2.0:1736271901.318718:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271901.318720:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271901.318723:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024109440:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271901.318724:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271901.318730:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024109312:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271901.318731:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271901.318733:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271901.318735:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024109120:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271901.318744:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271901.318745:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024109184:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271901.318745:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271901.318748:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024109248:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271901.318749:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736271901.318749:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109056 00000100:00100000:1.0:1736271901.318754:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024109376:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271901.318761:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271901.318763:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271901.318764:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:2.0:1736271901.318765:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024108992:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271901.318767:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024108928:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271901.318768:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb11c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024109056:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271901.318772:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271901.318795:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb11c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024109056:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (72us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271901.318800:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:0.0:1736271901.318808:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024109056:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271901.318813:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109376 00000100:00100000:3.0:1736271901.318826:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7119 00000100:00100000:3.0:1736271901.318828:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb14c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024109376:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271901.318858:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb14c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024109376:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271901.318862:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7119 00000100:00100000:0.0:1736271901.318873:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024109376:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271901.978445:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271902.980512:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271903.982468:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271904.984467:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271905.014429:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009351da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024109504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271905.014482:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271905.014497:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024109568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271905.014507:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109504 00000100:00100000:2.0:1736271905.014542:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5918 00000100:00100000:2.0:1736271905.014547:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024109504:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271905.014555:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1736271905.014570:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736271905.014573:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109568 00000100:00100000:3.0:1736271905.014605:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5919 00000100:00100000:2.0:1736271905.014608:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024109504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271905.014610:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb15580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024109568:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271905.014614:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5918 00002000:00000024:3.0:1736271905.014626:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:1.0:1736271905.014640:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009351da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024109504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271905.014661:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb15580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024109568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271905.014667:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5919 00000100:00100000:0.0:1736271905.014679:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024109568:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271905.986464:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271906.092475:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271906.092510:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271906.092543:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271906.092552:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980224 00000100:00100000:0.0:1736271906.092582:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980352 00000100:00100000:1.0:1736271906.092601:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980288 00000100:00100000:0.0:1736271906.092607:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 867 00000100:00100000:3.0:1736271906.092608:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 324 00000100:00100000:0.0:1736271906.092612:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058980352:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271906.092613:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058980224:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271906.092645:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1158 00000100:00100000:2.0:1736271906.092650:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058980288:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:2.0:1736271906.092663:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271906.092665:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058980352:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 53us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271906.092667:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058980224:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 53us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271906.092670:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 867 00000100:00100000:3.0:1736271906.092673:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 324 00000100:00100000:2.0:1736271906.092688:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058980288:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 38us (145us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271906.092692:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1158 00000100:00080000:2.0:1736271906.326461:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271906.326469:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271906.326476:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271906.326484:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8686 00000100:00080000:2.0:1736271906.326488:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271906.326493:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271906.326502:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024109632:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271906.326512:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13df00 x1820604024109696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271906.326567:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024109696:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271906.326569:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271906.326571:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271906.326574:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271906.326576:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271906.326579:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8686 00000100:00080000:2.0:1736271906.326581:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271906.326585:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271906.326599:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13aac0 x1820604024109824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271906.326606:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271906.326607:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024109760:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271906.326614:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271906.326619:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271906.326619:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271906.326622:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024109888:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271906.326622:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8686 00000100:00080000:2.0:1736271906.326623:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271906.326625:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271906.326638:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109696 00000100:00100000:3.0:1736271906.326638:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109632 00000100:00100000:0.0:1736271906.326643:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024109824:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271906.326657:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271906.326661:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1736271906.326665:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024109632:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271906.326668:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109888 00000100:00100000:0.0:1736271906.326674:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1736271906.326677:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024109696:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271906.326682:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1736271906.326685:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb150c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024109888:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:0.0:1736271906.326692:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271906.326697:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024109632:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271906.326703:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1736271906.326716:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb150c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024109888:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (60us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271906.326720:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1736271906.326727:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024109696:12345-0@lo:38:kworker/u8:2.0 Request processed in 49us (122us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271906.326732:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271906.326733:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:2.0:1736271906.326736:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13c280 x1820604024109952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271906.326744:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024109888:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271906.326748:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109760 00000100:00100000:2.0:1736271906.326758:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1736271906.326759:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271906.326766:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084665a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024109760:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271906.326766:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024109632:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271906.326772:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109824 00000100:00080000:0.0:1736271906.326777:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271906.326780:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271906.326783:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024109696:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271906.326785:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:2.0:1736271906.326785:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084665a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024109760:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (54us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271906.326787:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024109824:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271906.326789:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:3.0:1736271906.326792:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024109760:0@lo:400:kworker/u8:2.0 00010000:02000000:1.0:1736271906.326793:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271906.326797:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024109952:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271906.326809:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024110016:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271906.326818:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024109824:12345-0@lo:38:kworker/u8:2.0 Request processed in 31us (60us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271906.326820:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271906.326822:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:2.0:1736271906.326826:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271906.326836:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271906.326838:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271906.326840:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024109952 00000100:00100000:0.0:1736271906.326841:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024109824:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271906.326843:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110016 00000100:00080000:2.0:1736271906.326846:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271906.326848:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271906.326849:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271906.326851:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8686 00000100:00080000:2.0:1736271906.326852:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:1.0:1736271906.326854:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112837 00000100:00080000:2.0:1736271906.326854:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271906.326857:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024109952:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271906.326857:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736271906.326860:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024110080:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271906.326860:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7120 00010000:02000000:1.0:1736271906.326863:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271906.326863:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024110016:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271906.326874:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271906.326891:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024109952:12345-0@lo:38:kworker/u8:2.0 Request processed in 32us (70us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271906.326894:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024110016:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271906.326895:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110080 00000100:00100000:1.0:1736271906.326896:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112837 00000100:00100000:2.0:1736271906.326897:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024110016:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271906.326899:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7120 00000100:00100000:3.0:1736271906.326909:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7121 00000100:00100000:3.0:1736271906.326912:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c139c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024110080:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271906.326917:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13cc00 x1820604024110144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271906.326927:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271906.326930:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271906.326933:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024109952:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271906.326942:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c139c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024110080:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271906.326944:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024110144:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271906.326947:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7121 00000100:00100000:2.0:1736271906.326951:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024110080:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271906.326963:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271906.326996:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110144 00000100:00100000:1.0:1736271906.327012:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1736271906.327015:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024110144:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271906.327021:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271906.327044:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024110144:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (81us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271906.327049:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00080000:0.0:1736271906.327068:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271906.327071:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271906.327074:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024110144:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271906.988459:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271907.990456:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271908.992437:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271909.994462:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271910.022492:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009351b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024110208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271910.022509:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024110272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271910.022562:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271910.022590:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271910.022621:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110208 00000100:00100000:1.0:1736271910.022642:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110272 00000100:00100000:2.0:1736271910.022672:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5920 00000100:00100000:1.0:1736271910.022677:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5921 00000100:00100000:2.0:1736271910.022678:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084665f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024110208:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271910.022681:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb13dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024110272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1736271910.022705:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271910.022705:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:1.0:1736271910.022748:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb13dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024110272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271910.022768:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084665f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024110208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271910.022774:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5921 00000100:00100000:2.0:1736271910.022779:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5920 00000100:00100000:0.0:1736271910.022786:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024110272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271910.022810:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009351b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024110208:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271910.996453:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271911.100699:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271911.100736:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271911.100775:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980480 00000100:00100000:0.0:1736271911.100779:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271911.100807:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980544 00000100:00100000:1.0:1736271911.100815:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1162 00000100:00100000:1.0:1736271911.100823:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009351b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058980480:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:2.0:1736271911.100826:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 870 00000100:00100000:2.0:1736271911.100829:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084648980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058980544:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00010000:02000000:1.0:1736271911.100842:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271911.100846:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980416 00000100:00100000:3.0:1736271911.100883:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 326 00000100:00100000:3.0:1736271911.100887:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058980416:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271911.100890:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009351b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058980480:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 68us (197us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271911.100891:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084648980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058980544:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 60us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271911.100896:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1162 00000100:00100000:2.0:1736271911.100899:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 870 00000100:00100000:3.0:1736271911.100911:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058980416:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 24us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271911.100915:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 326 00000100:00080000:3.0:1736271911.334426:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271911.334431:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271911.334434:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736271911.334444:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024110336:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271911.334450:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8691 00000100:00080000:3.0:1736271911.334453:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:3.0:1736271911.334459:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271911.334475:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084666880 x1820604024110400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271911.334494:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084666880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024110400:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271911.334499:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271911.334501:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271911.334502:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736271911.334503:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736271911.334504:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8691 00000100:00080000:3.0:1736271911.334505:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:3.0:1736271911.334508:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271911.334529:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271911.334535:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110336 00000100:00100000:2.0:1736271911.334539:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736271911.334545:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084666d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024110464:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271911.334562:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1736271911.334565:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271911.334566:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024110336:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271911.334569:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110400 00000100:00100000:1.0:1736271911.334591:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110464 00000100:00100000:0.0:1736271911.334595:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1736271911.334598:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024110400:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271911.334602:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024110336:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271911.334607:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00010000:02000000:0.0:1736271911.334609:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271911.334611:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1736271911.334615:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1384c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024110464:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271911.334617:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024110336:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271911.334631:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024110400:12345-0@lo:38:kworker/u8:2.0 Request processed in 33us (102us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271911.334631:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084667200 x1820604024110528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271911.334635:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00080000:3.0:1736271911.334647:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736271911.334648:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084667200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024110528:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271911.334649:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271911.334650:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736271911.334651:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1384c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024110464:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271911.334651:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024110592:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271911.334652:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8691 00000100:00080000:3.0:1736271911.334654:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:1.0:1736271911.334655:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00080000:3.0:1736271911.334656:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271911.334660:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271911.334664:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110528 00000100:00100000:3.0:1736271911.334667:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800846663c0 x1820604024110656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271911.334668:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271911.334672:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271911.334678:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110592 00000100:00080000:0.0:1736271911.334679:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271911.334679:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271911.334682:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084666880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024110400:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271911.334682:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024110720:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271911.334683:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271911.334684:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271911.334685:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271911.334687:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8691 00000100:00080000:3.0:1736271911.334688:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:1.0:1736271911.334689:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00080000:3.0:1736271911.334690:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271911.334691:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024110656:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271911.334691:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1397c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024110592:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271911.334693:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736271911.334695:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271911.334698:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084660980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024110784:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271911.334707:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271911.334708:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1397c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024110592:12345-0@lo:400:kworker/u8:2.0 Request processed in 17us (41us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271911.334711:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:2.0:1736271911.334713:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110720 00000100:00100000:1.0:1736271911.334719:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:3.0:1736271911.334719:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271911.334721:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024110528:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271911.334726:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271911.334729:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110784 00000100:00100000:3.0:1736271911.334736:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7122 00000100:00100000:1.0:1736271911.334738:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024110528:12345-0@lo:38:kworker/u8:2.0 Request processed in 16us (78us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271911.334739:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110656 00000100:00100000:2.0:1736271911.334739:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7123 00000100:00100000:3.0:1736271911.334739:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024110720:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271911.334742:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024110784:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271911.334747:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1736271911.334751:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112838 00000100:00100000:0.0:1736271911.334753:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084648e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024110656:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271911.334754:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024110720:12345-0@lo:400:kworker/u8:2.0 Request processed in 15us (58us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271911.334757:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7122 00010000:02000000:0.0:1736271911.334758:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271911.334770:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024110784:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (51us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271911.334771:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084648e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024110656:12345-0@lo:38:kworker/u8:2.0 Request processed in 17us (63us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271911.334774:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112838 00000100:00100000:2.0:1736271911.334774:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7123 00000100:00100000:3.0:1736271911.334776:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084660980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024110784:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271911.334788:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084660980 x1820604024110848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271911.334789:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271911.334790:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271911.334792:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024110656:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271911.334797:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271911.334798:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271911.334799:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084667200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024110528:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271911.334808:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084660980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024110848:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271911.334818:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271911.334845:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110848 00000100:00100000:1.0:1736271911.334856:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1736271911.334858:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024110848:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271911.334862:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271911.334883:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024110848:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (63us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736271911.334886:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271911.334887:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00080000:0.0:1736271911.334888:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271911.334890:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084660980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024110848:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271911.335010:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024110720:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271911.335017:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024110592:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271911.335070:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084666d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024110464:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271911.998490:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271913.000445:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271914.002452:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271915.004443:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271915.030445:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846497c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024110912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271915.030472:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb176c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024110976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271915.030507:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271915.030529:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271915.030529:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110912 00000100:00100000:2.0:1736271915.030559:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024110976 00000100:00100000:0.0:1736271915.030572:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5922 00000100:00100000:0.0:1736271915.030586:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084661300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024110912:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271915.030586:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5923 00000100:00100000:2.0:1736271915.030590:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024110976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271915.030609:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:0.0:1736271915.030613:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271915.030643:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024110976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271915.030648:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5923 00000100:00100000:0.0:1736271915.030661:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084661300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024110912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271915.030667:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5922 00000100:00100000:1.0:1736271915.030668:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb176c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024110976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271915.030691:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846497c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024110912:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271916.006492:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271916.108454:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271916.108495:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271916.108532:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980608 00000100:00100000:0.0:1736271916.108533:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271916.108556:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980736 00000100:00100000:2.0:1736271916.108566:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 328 00000100:00100000:2.0:1736271916.108571:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058980608:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271916.108580:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980672 00000100:00100000:0.0:1736271916.108586:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 873 00000100:00100000:0.0:1736271916.108591:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058980736:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271916.108595:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1166 00000100:00100000:1.0:1736271916.108597:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084649300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058980672:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271916.108606:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271916.108631:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058980608:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 61us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271916.108633:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058980736:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 42us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271916.108633:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084649300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058980672:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 35us (100us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271916.108636:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 328 00000100:00100000:1.0:1736271916.108639:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1166 00000100:00100000:0.0:1736271916.108642:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 873 00000100:00080000:3.0:1736271916.342436:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271916.342454:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271916.342457:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271916.342462:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8696 00000100:00100000:0.0:1736271916.342466:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084662600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024111040:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271916.342466:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1736271916.342471:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271916.342488:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084666d40 x1820604024111104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271916.342529:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736271916.342532:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271916.342535:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271916.342536:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271916.342539:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8696 00000100:00080000:3.0:1736271916.342540:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1736271916.342544:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271916.342550:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736271916.342561:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024111168:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271916.342574:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084666d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024111104:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271916.342588:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271916.342603:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111040 00000100:00100000:0.0:1736271916.342610:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111168 00000100:00100000:3.0:1736271916.342626:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084660980 x1820604024111232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271916.342635:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1736271916.342636:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:0.0:1736271916.342640:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846604c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024111168:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271916.342641:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024111040:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271916.342641:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271916.342643:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271916.342644:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271916.342647:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8696 00000100:00080000:3.0:1736271916.342648:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1736271916.342651:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271916.342657:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024111296:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271916.342674:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846604c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024111168:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271916.342677:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024111040:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271916.342679:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:1.0:1736271916.342682:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1736271916.342684:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271916.342697:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111296 00000100:00100000:1.0:1736271916.342709:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084662600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024111040:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271916.342709:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024111168:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271916.342713:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1736271916.342716:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846617c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024111296:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271916.342736:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800846676c0 x1820604024111360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271916.342744:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846617c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024111296:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271916.342748:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:2.0:1736271916.342762:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024111296:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271916.342768:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736271916.342768:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271916.342771:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271916.342772:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271916.342775:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8696 00000100:00080000:3.0:1736271916.342776:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1736271916.342779:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271916.342783:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084660980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024111232:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271916.342787:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084667200 x1820604024111552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271916.342788:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084661c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024111424:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271916.342799:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271916.342812:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271916.342826:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271916.342830:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084663900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024111488:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271916.342833:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024111360:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271916.342835:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111424 00000100:00100000:1.0:1736271916.342844:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271916.342849:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111104 00000100:00100000:0.0:1736271916.342852:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271916.342856:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111488 00000100:00100000:2.0:1736271916.342864:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:0.0:1736271916.342865:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084667200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024111552:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271916.342868:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024111104:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271916.342869:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7124 00000100:00100000:3.0:1736271916.342872:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb176c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024111424:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271916.342877:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7125 00010000:02000000:2.0:1736271916.342877:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271916.342878:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271916.342881:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb10980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024111488:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271916.342895:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111232 00000100:00100000:0.0:1736271916.342904:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111552 00000100:00100000:1.0:1736271916.342907:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb10980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024111488:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (63us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271916.342908:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb176c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024111424:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271916.342909:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024111104:12345-0@lo:38:kworker/u8:2.0 Request processed in 41us (141us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271916.342911:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:1.0:1736271916.342912:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7125 00000100:00100000:0.0:1736271916.342913:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024111232:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271916.342914:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:3.0:1736271916.342915:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7124 00010000:02000000:0.0:1736271916.342918:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271916.342925:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1736271916.342927:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024111552:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271916.342929:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111360 00000100:00100000:0.0:1736271916.342933:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024111232:12345-0@lo:38:kworker/u8:2.0 Request processed in 19us (133us total) trans 0 rc -19/-19 00010000:02000000:2.0:1736271916.342933:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271916.342938:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1736271916.342940:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084663900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024111488:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271916.342943:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112839 00000100:00100000:1.0:1736271916.342946:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024111360:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271916.342948:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084661c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024111424:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271916.342949:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024111552:12345-0@lo:38:kworker/u8:2.0 Request processed in 20us (70us total) trans 0 rc -19/-19 00010000:02000000:1.0:1736271916.342953:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271916.342954:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00080000:0.0:1736271916.342963:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271916.342966:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271916.342969:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084667200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024111552:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271916.342972:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024111360:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (121us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736271916.342977:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271916.342977:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112839 00000100:00080000:0.0:1736271916.342979:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271916.342981:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084660980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024111232:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271916.343004:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271916.343012:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271916.343014:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024111360:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271916.343025:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271916.343026:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271916.343028:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084666d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024111104:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271917.008467:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271918.010431:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271919.012495:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271920.014464:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271920.038489:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024111616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271920.038489:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024111680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271920.038545:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271920.038591:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111616 00000100:00100000:3.0:1736271920.038608:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271920.038642:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111680 00000100:00100000:2.0:1736271920.038658:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5924 00000100:00100000:2.0:1736271920.038665:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb104c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024111616:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271920.038668:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5925 00000100:00100000:1.0:1736271920.038673:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084661c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024111680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1736271920.038692:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:2.0:1736271920.038692:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:1.0:1736271920.038727:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084661c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024111680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271920.038730:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb104c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024111616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271920.038736:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5924 00000100:00100000:1.0:1736271920.038740:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5925 00000100:00100000:3.0:1736271920.038750:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024111680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271920.038751:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024111616:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271921.016469:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271921.116561:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271921.116612:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271921.116655:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980800 00000100:00100000:0.0:1736271921.116663:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271921.116691:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980928 00000100:00100000:1.0:1736271921.116704:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 330 00000100:00100000:1.0:1736271921.116710:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058980800:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271921.116745:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980864 00000100:00100000:3.0:1736271921.116749:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 876 00000100:00100000:3.0:1736271921.116755:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058980928:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271921.116763:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1170 00000100:00100000:2.0:1736271921.116767:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846484c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058980864:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:1.0:1736271921.116775:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058980800:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271921.116782:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 330 00000100:00100000:3.0:1736271921.116791:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058980928:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 36us (179us total) trans 0 rc 0/0 00010000:02000000:2.0:1736271921.116793:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271921.116797:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 876 00000100:00100000:2.0:1736271921.116820:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846484c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058980864:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 52us (158us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271921.116827:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1170 00000100:00080000:3.0:1736271921.350438:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271921.350445:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271921.350449:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271921.350456:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8701 00000100:00080000:3.0:1736271921.350461:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1736271921.350467:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271921.350479:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084663900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024111744:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271921.350488:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800846663c0 x1820604024111808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:3.0:1736271921.350512:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271921.350515:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024111808:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271921.350516:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271921.350517:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271921.350519:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8701 00000100:00080000:3.0:1736271921.350521:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1736271921.350524:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271921.350532:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084666d40 x1820604024111936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271921.350546:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271921.350557:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736271921.350563:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271921.350566:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1736271921.350577:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271921.350578:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084666d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024111936:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271921.350580:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736271921.350582:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084666880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024111872:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271921.350584:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8701 00000100:00080000:3.0:1736271921.350585:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1736271921.350588:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271921.350594:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736271921.350596:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271921.350601:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024112000:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271921.350618:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111744 00000100:00100000:2.0:1736271921.350618:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111808 00000100:00100000:3.0:1736271921.350623:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271921.350635:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111936 00000100:00100000:2.0:1736271921.350647:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112000 00000100:00100000:0.0:1736271921.350648:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1736271921.350650:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084667200 x1820604024112064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271921.350654:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024111744:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271921.350654:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1736271921.350663:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb16880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024111808:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271921.350664:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084667200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024112064:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271921.350667:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:2.0:1736271921.350671:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084660980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024112000:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:1.0:1736271921.350677:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271921.350685:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271921.350687:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024111744:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271921.350693:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1736271921.350703:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb16880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024111808:12345-0@lo:38:kworker/u8:2.0 Request processed in 45us (146us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736271921.350710:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271921.350712:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271921.350713:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084660980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024112000:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271921.350714:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1736271921.350715:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024111808:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271921.350719:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:1.0:1736271921.350725:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:1.0:1736271921.350728:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024111936:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271921.350733:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271921.350738:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271921.350739:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112064 00000100:00100000:1.0:1736271921.350752:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024111936:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (156us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271921.350753:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024111872 00000100:00100000:3.0:1736271921.350755:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112840 00000100:00100000:0.0:1736271921.350757:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084663900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024111744:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271921.350758:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:3.0:1736271921.350758:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024112064:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271921.350765:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271921.350768:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:2.0:1736271921.350771:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024111872:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271921.350784:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024112064:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (98us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271921.350789:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112840 00000100:00080000:1.0:1736271921.350790:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271921.350798:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271921.350800:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024111872:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271921.350801:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084667200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024112064:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271921.350811:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084666880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024111872:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271921.350811:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024112000:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271921.350812:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00080000:1.0:1736271921.350813:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271921.350814:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271921.350816:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084666d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024111936:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271921.350837:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271921.350840:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271921.350841:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736271921.350844:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024112192:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271921.350844:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024112128:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271921.350849:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8701 00000100:00080000:3.0:1736271921.350851:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1736271921.350854:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271921.350863:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084662600 x1820604024112256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271921.350868:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271921.350888:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271921.350898:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112128 00000100:00100000:1.0:1736271921.350901:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084662600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024112256:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271921.350910:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112192 00000100:00100000:2.0:1736271921.350918:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7126 00000100:00100000:2.0:1736271921.350922:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024112128:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271921.350923:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271921.350939:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7127 00000100:00100000:3.0:1736271921.350943:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024112192:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271921.350950:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024112128:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271921.350972:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7126 00000100:00100000:3.0:1736271921.350987:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024112192:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271921.350992:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112256 00000100:00100000:3.0:1736271921.350992:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7127 00000100:00100000:1.0:1736271921.351004:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024112192:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271921.351006:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1736271921.351010:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb12ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024112256:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271921.351016:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271921.351016:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024112128:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271921.351037:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb12ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024112256:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (115us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271921.351042:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00080000:1.0:1736271921.351046:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271921.351048:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271921.351051:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084662600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024112256:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271922.018468:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271923.020474:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271924.022478:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271925.024450:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271925.046440:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271925.046447:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736271925.046461:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084649c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024112384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271925.046472:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084662600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024112320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271925.046514:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271925.046548:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271925.046563:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112384 00000100:00100000:3.0:1736271925.046578:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112320 00000100:00100000:2.0:1736271925.046604:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5926 00000100:00100000:2.0:1736271925.046608:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846676c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024112384:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271925.046615:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5927 00000100:00100000:3.0:1736271925.046619:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024112320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271925.046629:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:3.0:1736271925.046643:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271925.046672:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846676c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024112384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271925.046678:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5926 00000100:00100000:3.0:1736271925.046685:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024112320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271925.046691:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5927 00000100:00100000:0.0:1736271925.046710:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084649c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024112384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271925.046712:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084662600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024112320:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271926.026441:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271926.124555:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271926.124593:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271926.124622:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058980992 00000100:00100000:0.0:1736271926.124635:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271926.124661:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 332 00000100:00100000:3.0:1736271926.124664:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981120 00000100:00100000:2.0:1736271926.124667:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058980992:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271926.124688:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981056 00000100:00100000:3.0:1736271926.124695:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 879 00000100:00100000:3.0:1736271926.124697:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084649c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058981120:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271926.124699:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1174 00000100:00100000:0.0:1736271926.124703:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058981056:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271926.124714:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271926.124726:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058980992:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 59us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271926.124729:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084649c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058981120:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 31us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271926.124733:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 332 00000100:00100000:3.0:1736271926.124733:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 879 00000100:00100000:0.0:1736271926.124741:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058981056:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 38us (106us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271926.124746:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1174 00000100:00080000:3.0:1736271926.358419:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271926.358423:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271926.358426:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271926.358429:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8706 00000100:00080000:3.0:1736271926.358432:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:3.0:1736271926.358435:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271926.358454:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084666d40 x1820604024112512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271926.358461:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024112448:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271926.358488:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271926.358491:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271926.358492:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271926.358495:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8706 00000100:00080000:3.0:1736271926.358496:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:3.0:1736271926.358498:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271926.358506:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084666880 x1820604024112640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:3.0:1736271926.358518:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271926.358520:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271926.358521:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736271926.358524:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736271926.358524:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8706 00000100:00080000:3.0:1736271926.358525:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:3.0:1736271926.358527:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271926.358528:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084666d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024112512:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271926.358547:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084662600 x1820604024112768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271926.358562:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736271926.358565:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271926.358567:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024112832:0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271926.358569:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271926.358571:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271926.358572:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271926.358574:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8706 00000100:00080000:3.0:1736271926.358575:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:3.0:1736271926.358578:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271926.358579:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112448 00000100:00100000:1.0:1736271926.358580:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084666880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024112640:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271926.358585:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008c8a2140 x1820604024112960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271926.358596:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271926.358596:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271926.358608:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1736271926.358613:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024112448:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271926.358616:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084662600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024112768:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271926.358617:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112512 00000100:00100000:0.0:1736271926.358620:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024112896:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271926.358633:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112640 00000100:00100000:1.0:1736271926.358635:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271926.358636:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271926.358643:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:3.0:1736271926.358645:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb12140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024112512:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271926.358648:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024112960:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271926.358650:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024112448:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271926.358655:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00010000:02000000:3.0:1736271926.358655:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271926.358661:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024112448:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271926.358662:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271926.358681:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb12140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024112512:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (116us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736271926.358685:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271926.358686:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112960 00000100:00100000:3.0:1736271926.358686:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00080000:1.0:1736271926.358688:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271926.358691:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084666d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024112512:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271926.358691:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112768 00000100:00100000:3.0:1736271926.358697:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:3.0:1736271926.358699:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb16d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024112640:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271926.358703:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:2.0:1736271926.358704:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112841 00010000:02000000:3.0:1736271926.358704:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271926.358707:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb13440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024112960:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271926.358707:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb13900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024112768:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271926.358709:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084667200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024112576:0@lo:400:kworker/u8:2.0 00010000:02000000:2.0:1736271926.358712:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736271926.358714:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271926.358723:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb16d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024112640:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (128us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271926.358728:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271926.358729:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:3.0:1736271926.358736:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112576 00000100:00100000:0.0:1736271926.358738:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb13440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024112960:12345-0@lo:38:kworker/u8:2.0 Request processed in 30us (76us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271926.358738:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271926.358739:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb13900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024112768:12345-0@lo:38:kworker/u8:2.0 Request processed in 31us (103us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271926.358741:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084663900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024112704:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271926.358744:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:2.0:1736271926.358744:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112841 00000100:00100000:1.0:1736271926.358754:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271926.358758:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112832 00000100:00100000:3.0:1736271926.358766:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112704 00000100:00100000:2.0:1736271926.358772:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024112896 00000100:00100000:3.0:1736271926.358775:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1736271926.358783:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1736271926.358783:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7128 00000100:00100000:3.0:1736271926.358783:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024112576:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271926.358786:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024112832:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271926.358787:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb14280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024112704:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271926.358796:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271926.358798:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271926.358801:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084662600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024112768:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271926.358806:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271926.358808:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271926.358810:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024112960:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271926.358811:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024112832:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271926.358811:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024112576:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271926.358816:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb14280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024112704:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (61us total) trans 0 rc 0/0 00000100:00080000:1.0:1736271926.358816:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271926.358816:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7128 00000100:00100000:3.0:1736271926.358816:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00080000:1.0:1736271926.358818:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271926.358820:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084666880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024112640:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271926.358822:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1736271926.358825:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7129 00000100:00100000:2.0:1736271926.358827:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846497c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024112896:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271926.358843:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084663900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024112704:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271926.358850:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846497c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024112896:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271926.358852:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084667200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024112576:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271926.358853:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024112896:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271926.358854:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7129 00000100:00100000:0.0:1736271926.358862:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024112832:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271927.028477:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271928.030447:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271929.032439:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271930.034463:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271930.054415:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024113088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271930.054415:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024113024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271930.054464:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271930.054507:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271930.054508:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113088 00000100:00100000:2.0:1736271930.054551:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113024 00000100:00100000:2.0:1736271930.054566:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5928 00000100:00100000:2.0:1736271930.054570:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084667200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024113088:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271930.054573:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5929 00000100:00100000:0.0:1736271930.054578:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb10e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024113024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271930.054593:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:0.0:1736271930.054594:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271930.054625:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb10e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024113024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271930.054635:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084667200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024113088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271930.054636:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5929 00000100:00100000:1.0:1736271930.054638:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024113024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271930.054641:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5928 00000100:00100000:0.0:1736271930.054665:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024113088:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271931.036443:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271931.132608:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271931.132654:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271931.132685:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981184 00000100:00100000:0.0:1736271931.132696:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271931.132719:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981312 00000100:00100000:3.0:1736271931.132726:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 334 00000100:00100000:3.0:1736271931.132730:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058981184:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271931.132738:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981248 00000100:00100000:0.0:1736271931.132744:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 882 00000100:00100000:0.0:1736271931.132748:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084663900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058981312:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271931.132766:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1178 00000100:00100000:1.0:1736271931.132770:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084666880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058981248:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:3.0:1736271931.132778:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058981184:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 48us (176us total) trans 0 rc 0/0 00010000:02000000:1.0:1736271931.132782:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271931.132782:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 334 00000100:00100000:0.0:1736271931.132784:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084663900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058981312:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 35us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271931.132790:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 882 00000100:00100000:1.0:1736271931.132807:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084666880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058981248:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 37us (111us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271931.132813:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1178 00000100:00080000:3.0:1736271931.366426:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271931.366432:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271931.366435:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271931.366441:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8711 00000100:00080000:3.0:1736271931.366444:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:3.0:1736271931.366449:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271931.366462:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024113152:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271931.366465:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008c8a0e40 x1820604024113216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:3.0:1736271931.366502:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271931.366505:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271931.366506:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271931.366509:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8711 00000100:00080000:3.0:1736271931.366510:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:3.0:1736271931.366513:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271931.366519:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271931.366529:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024113280:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271931.366532:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008c8a5580 x1820604024113344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:3.0:1736271931.366555:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271931.366558:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1736271931.366559:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736271931.366559:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271931.366562:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8711 00000100:00080000:3.0:1736271931.366563:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00100000:2.0:1736271931.366564:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113152 00000100:00080000:3.0:1736271931.366566:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271931.366574:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008c8a3dc0 x1820604024113472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271931.366586:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024113216:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271931.366589:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024113536:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271931.366601:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1736271931.366606:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024113152:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271931.366614:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271931.366614:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736271931.366615:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271931.366618:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271931.366619:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271931.366621:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8711 00000100:00080000:3.0:1736271931.366623:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:3.0:1736271931.366626:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271931.366629:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736271931.366631:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024113344:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271931.366634:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024113408:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271931.366634:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008c8a76c0 x1820604024113664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271931.366641:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024113152:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271931.366647:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1736271931.366649:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271931.366658:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113536 00000100:00100000:1.0:1736271931.366663:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024113472:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271931.366664:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113280 00000100:00100000:2.0:1736271931.366675:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024113600:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271931.366680:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271931.366681:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7130 00000100:00100000:0.0:1736271931.366685:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084666d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024113536:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271931.366685:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113216 00000100:00100000:3.0:1736271931.366694:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113344 00000100:00100000:1.0:1736271931.366695:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024113664:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271931.366696:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271931.366704:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:3.0:1736271931.366708:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084662600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024113280:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271931.366709:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271931.366712:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084666d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024113536:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271931.366717:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7130 00000100:00100000:1.0:1736271931.366724:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113664 00000100:00100000:2.0:1736271931.366724:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024113152:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271931.366727:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113600 00000100:00100000:1.0:1736271931.366733:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1736271931.366735:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb14740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024113216:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271931.366737:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084662600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024113280:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (179us total) trans 0 rc 0/0 00010000:02000000:1.0:1736271931.366743:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271931.366743:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:0.0:1736271931.366748:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7131 00000100:00100000:0.0:1736271931.366751:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024113600:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271931.366759:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb14740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024113216:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (146us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271931.366760:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1736271931.366763:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1736271931.366763:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb12600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024113344:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271931.366769:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113472 00010000:02000000:3.0:1736271931.366769:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271931.366770:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1736271931.366773:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb14c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024113664:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271931.366776:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024113600:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271931.366781:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7131 00000100:00100000:2.0:1736271931.366783:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112842 00010000:02000000:1.0:1736271931.366784:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271931.366787:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb11300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024113472:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271931.366787:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb12600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024113344:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (137us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271931.366792:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00010000:02000000:2.0:1736271931.366794:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271931.366799:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271931.366801:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb14c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024113664:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (91us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271931.366806:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1736271931.366810:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113408 00000100:00100000:2.0:1736271931.366817:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb11300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024113472:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (137us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271931.366821:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024113536:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271931.366823:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112842 00000100:00100000:3.0:1736271931.366825:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:3.0:1736271931.366828:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846663c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024113408:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271931.366840:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271931.366842:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271931.366843:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024113280:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271931.366845:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024113664:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271931.366852:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736271931.366853:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846663c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024113408:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (53us total) trans 0 rc 0/0 00000100:00080000:1.0:1736271931.366854:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271931.366856:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a0e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024113216:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271931.366858:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1736271931.366860:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024113408:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271931.366862:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271931.366864:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271931.366866:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024113344:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271931.366871:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271931.366873:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271931.366875:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024113472:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271931.366927:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024113600:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271932.038428:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271933.040488:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271934.042441:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271935.044511:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271935.062436:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271935.062467:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024113792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271935.062478:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736271935.062496:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024113728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271935.062533:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271935.062589:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271935.062591:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113792 00000100:00100000:0.0:1736271935.062624:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113728 00000100:00100000:1.0:1736271935.062632:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5930 00000100:00100000:1.0:1736271935.062637:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c485a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024113792:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271935.062657:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5931 00000100:00100000:0.0:1736271935.062661:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024113728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1736271935.062661:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:0.0:1736271935.062688:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736271935.062697:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c485a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024113792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271935.062715:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5930 00000100:00100000:2.0:1736271935.062727:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024113792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271935.062741:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024113728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271935.062747:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5931 00000100:00100000:3.0:1736271935.062778:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024113728:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271936.046448:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271936.140505:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271936.140537:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271936.140564:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271936.140579:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981376 00000100:00100000:0.0:1736271936.140594:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981440 00000100:00100000:3.0:1736271936.140594:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981504 00000100:00100000:0.0:1736271936.140612:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 885 00000100:00100000:2.0:1736271936.140614:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 336 00000100:00100000:0.0:1736271936.140616:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4850c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058981504:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271936.140619:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058981376:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271936.140623:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1182 00000100:00100000:3.0:1736271936.140626:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058981440:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736271936.140636:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271936.140664:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4850c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058981504:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 48us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271936.140667:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058981376:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 47us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271936.140668:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 885 00000100:00100000:3.0:1736271936.140668:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058981440:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 41us (103us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271936.140671:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1182 00000100:00100000:2.0:1736271936.140682:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 336 00000100:00080000:3.0:1736271936.374416:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271936.374423:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271936.374435:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271936.374441:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8716 00000100:00080000:3.0:1736271936.374446:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:3.0:1736271936.374450:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271936.374461:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024113856:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271936.374467:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008c8a7200 x1820604024113920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271936.374495:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024113920:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271936.374497:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271936.374500:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271936.374502:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271936.374504:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8716 00000100:00080000:3.0:1736271936.374506:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:3.0:1736271936.374509:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271936.374516:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024113984:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271936.374533:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271936.374541:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271936.374559:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008c8a3440 x1820604024114048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271936.374576:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271936.374582:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a3440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024114048:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271936.374583:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113856 00000100:00100000:1.0:1736271936.374601:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736271936.374613:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736271936.374614:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113920 00000100:00100000:2.0:1736271936.374614:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00080000:3.0:1736271936.374616:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271936.374618:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736271936.374619:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024113856:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271936.374620:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8716 00000100:00080000:3.0:1736271936.374622:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:3.0:1736271936.374625:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271936.374631:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024113984 00000100:00100000:3.0:1736271936.374634:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114048 00000100:00100000:1.0:1736271936.374639:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1736271936.374642:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb17200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024113920:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271936.374647:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1736271936.374649:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024113984:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271936.374649:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024113856:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (117us total) trans 0 rc 0/0 00010000:02000000:1.0:1736271936.374653:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271936.374653:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1736271936.374654:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1736271936.374656:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cef2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024114048:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271936.374670:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271936.374672:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024114112:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271936.374684:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024113984:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271936.374690:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:1.0:1736271936.374696:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb17200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024113920:12345-0@lo:38:kworker/u8:2.0 Request processed in 52us (155us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271936.374700:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271936.374702:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:3.0:1736271936.374704:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cef2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024114048:12345-0@lo:38:kworker/u8:2.0 Request processed in 47us (103us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271936.374710:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:0.0:1736271936.374711:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114112 00000100:00100000:3.0:1736271936.374721:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:2.0:1736271936.374723:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024113856:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271936.374724:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c138980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024114112:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271936.374740:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271936.374743:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271936.374746:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a3440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024114048:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271936.374749:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c138980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024114112:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (49us total) trans 0 rc 0/0 00000100:00080000:1.0:1736271936.374752:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271936.374754:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271936.374754:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1736271936.374755:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024113920:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271936.374767:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024114112:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271936.374777:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024113984:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271936.374793:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008c8a2f80 x1820604024114176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271936.374806:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024114176:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271936.374823:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736271936.374827:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1736271936.374829:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1736271936.374830:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736271936.374832:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8716 00000100:00080000:3.0:1736271936.374833:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:3.0:1736271936.374834:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271936.374839:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008c8a0000 x1820604024114368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271936.374840:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024114240:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271936.374842:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114176 00000100:00100000:2.0:1736271936.374848:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024114304:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271936.374872:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112843 00000100:00100000:3.0:1736271936.374875:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cef6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024114176:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271936.374879:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271936.374880:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024114368:0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271936.374880:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271936.374900:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cef6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024114176:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (77us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271936.374902:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271936.374903:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271936.374909:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112843 00000100:00080000:1.0:1736271936.374912:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271936.374913:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114240 00000100:00080000:1.0:1736271936.374918:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271936.374920:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024114176:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271936.374921:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114368 00000100:00100000:0.0:1736271936.374930:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114304 00000100:00100000:3.0:1736271936.374930:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:3.0:1736271936.374932:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea63900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024114368:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271936.374935:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7132 00010000:02000000:3.0:1736271936.374935:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271936.374940:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7133 00000100:00100000:2.0:1736271936.374940:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c482f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024114240:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271936.374943:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024114304:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271936.374949:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea63900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024114368:12345-0@lo:38:kworker/u8:2.0 Request processed in 16us (47us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271936.374951:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:1.0:1736271936.374964:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024114304:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271936.374967:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7133 00000100:00100000:2.0:1736271936.374972:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c482f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024114240:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271936.374978:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7132 00000100:00100000:0.0:1736271936.374982:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024114240:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271936.374982:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736271936.374983:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024114304:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271936.374984:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271936.374986:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024114368:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271937.048465:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271938.050444:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271939.052446:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271940.054556:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271940.070411:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736271940.070428:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024114432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271940.070489:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736271940.070495:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271940.070498:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024114496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271940.070528:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271940.070533:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114432 00000100:00100000:1.0:1736271940.070556:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114496 00000100:00100000:1.0:1736271940.070566:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5932 00000100:00100000:1.0:1736271940.070569:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024114432:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271940.070575:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5933 00000100:00100000:2.0:1736271940.070580:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024114496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1736271940.070588:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271940.070595:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736271940.070615:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024114432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271940.070619:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5932 00000100:00100000:2.0:1736271940.070636:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024114496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271940.070639:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024114432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271940.070640:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5933 00000100:00100000:3.0:1736271940.070665:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024114496:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271941.056434:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271941.148566:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271941.148597:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271941.148650:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981568 00000100:00100000:3.0:1736271941.148657:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981696 00000100:00100000:0.0:1736271941.148666:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271941.148694:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981632 00000100:00100000:0.0:1736271941.148702:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 888 00000100:00100000:1.0:1736271941.148704:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 338 00000100:00100000:0.0:1736271941.148710:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c482600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058981696:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271941.148711:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058981568:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271941.148725:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1186 00000100:00100000:3.0:1736271941.148729:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c485580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058981632:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736271941.148744:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271941.148767:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c482600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1895:x1820604058981696:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 59us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271941.148773:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 888 00000100:00100000:1.0:1736271941.148777:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058981568:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 66us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271941.148785:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c485580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058981632:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 55us (118us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271941.148791:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1186 00000100:00100000:1.0:1736271941.148795:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 338 00000100:00080000:0.0:1736271941.382489:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271941.382505:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271941.382508:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271941.382514:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8721 00000100:00080000:0.0:1736271941.382517:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00100000:2.0:1736271941.382518:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c480e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024114560:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271941.382522:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271941.382540:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c4817c0 x1820604024114624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736271941.382565:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271941.382567:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271941.382567:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271941.382569:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8721 00000100:00080000:0.0:1736271941.382570:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271941.382572:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271941.382577:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c484280 x1820604024114752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271941.382581:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4817c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024114624:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271941.382581:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271941.382584:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c482140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024114688:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271941.382591:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271941.382593:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736271941.382594:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271941.382596:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8721 00000100:00080000:0.0:1736271941.382597:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736271941.382598:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271941.382603:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271941.382610:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c486880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024114816:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271941.382615:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271941.382633:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c484280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024114752:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271941.382637:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114624 00000100:00100000:0.0:1736271941.382638:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271941.382660:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114816 00000100:00100000:3.0:1736271941.382663:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271941.382672:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114560 00000100:00100000:0.0:1736271941.382676:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114688 00000100:00100000:2.0:1736271941.382684:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:2.0:1736271941.382689:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4863c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024114816:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271941.382695:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1736271941.382698:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024114560:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271941.382705:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:0.0:1736271941.382708:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024114688:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271941.382728:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1736271941.382733:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea64280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024114624:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271941.382746:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024114560:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271941.382746:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4863c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024114816:12345-0@lo:400:kworker/u8:2.0 Request processed in 56us (108us total) trans 0 rc 0/0 00010000:02000000:3.0:1736271941.382750:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271941.382751:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1736271941.382753:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1736271941.382756:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024114688:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271941.382762:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1736271941.382774:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271941.382785:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c480e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024114560:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271941.382790:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea64280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024114624:12345-0@lo:38:kworker/u8:2.0 Request processed in 56us (175us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271941.382794:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114752 00000100:00100000:3.0:1736271941.382796:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00080000:1.0:1736271941.382802:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271941.382804:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271941.382807:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1736271941.382807:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c4817c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024114624:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271941.382809:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c486880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024114816:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271941.382810:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea60e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024114752:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271941.382836:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271941.382860:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea60e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024114752:12345-0@lo:38:kworker/u8:2.0 Request processed in 50us (86us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271941.382864:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1736271941.382867:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c482140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024114688:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271941.382869:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271941.382871:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271941.382874:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c484280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024114752:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271941.382878:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c482ac0 x1820604024114880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271941.382888:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c482ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024114880:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271941.382905:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1736271941.382907:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736271941.382909:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271941.382909:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736271941.382910:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736271941.382912:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8721 00000100:00080000:0.0:1736271941.382913:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:3.0:1736271941.382913:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c487200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024114944:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271941.382915:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271941.382920:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c484c00 x1820604024115072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271941.382920:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4876c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024115008:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271941.382930:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114880 00000100:00100000:3.0:1736271941.382935:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271941.382944:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112844 00000100:00100000:2.0:1736271941.382946:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271941.382947:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea62140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024114880:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271941.382953:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271941.382962:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024114944 00000100:00100000:3.0:1736271941.382963:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115008 00000100:00100000:0.0:1736271941.382975:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7134 00000100:00100000:0.0:1736271941.382978:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024114944:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271941.382985:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7135 00000100:00100000:1.0:1736271941.382986:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea62140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024114880:12345-0@lo:38:kworker/u8:2.0 Request processed in 27us (66us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271941.382987:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024115008:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271941.382991:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112844 00000100:00100000:1.0:1736271941.383008:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c484c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024115072:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271941.383010:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024114944:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (74us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271941.383016:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024115008:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271941.383021:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7134 00000100:00100000:3.0:1736271941.383024:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7135 00000100:00100000:2.0:1736271941.383026:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c487200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024114944:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271941.383027:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736271941.383037:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271941.383038:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271941.383039:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115072 00000100:00100000:1.0:1736271941.383040:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c482ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024114880:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271941.383048:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c4876c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024115008:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271941.383053:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1736271941.383055:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea65580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024115072:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271941.383061:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271941.383085:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea65580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024115072:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (58us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271941.383090:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00080000:1.0:1736271941.383093:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736271941.383095:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271941.383098:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c484c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024115072:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271942.058426:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271943.060493:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271944.062490:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271945.064450:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271945.078453:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024115136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271945.078464:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024115200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271945.078509:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271945.078553:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115136 00000100:00100000:0.0:1736271945.078561:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271945.078582:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115200 00000100:00100000:2.0:1736271945.078603:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5934 00000100:00100000:2.0:1736271945.078607:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a3440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024115136:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271945.078608:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5935 00000100:00100000:0.0:1736271945.078613:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4804c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024115200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736271945.078629:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00002000:00000024:2.0:1736271945.078629:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271945.078661:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4804c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024115200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271945.078662:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a3440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024115136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271945.078667:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5935 00000100:00100000:2.0:1736271945.078675:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5934 00000100:00100000:1.0:1736271945.078679:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024115200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271945.078679:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024115136:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271946.066435:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271946.156574:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271946.156618:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271946.156652:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981760 00000100:00100000:0.0:1736271946.156659:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271946.156685:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981888 00000100:00100000:3.0:1736271946.156691:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 340 00000100:00100000:3.0:1736271946.156697:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058981760:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271946.156711:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981824 00000100:00100000:2.0:1736271946.156723:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 891 00000100:00100000:2.0:1736271946.156727:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c483440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058981888:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271946.156732:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1190 00000100:00100000:1.0:1736271946.156738:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c486d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058981824:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271946.156751:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271946.156757:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058981760:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 60us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271946.156763:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c483440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058981888:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 35us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271946.156769:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 891 00000100:00100000:1.0:1736271946.156775:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c486d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058981824:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 37us (116us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271946.156775:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 340 00000100:00100000:1.0:1736271946.156916:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1190 00000100:00080000:1.0:1736271946.390442:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271946.390448:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1736271946.390450:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024115264:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271946.390451:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271946.390455:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8726 00000100:00080000:1.0:1736271946.390468:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1736271946.390473:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271946.390489:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea65a40 x1820604024115328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271946.390519:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271946.390529:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024115328:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271946.390530:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271946.390534:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271946.390535:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271946.390538:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8726 00000100:00080000:1.0:1736271946.390540:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1736271946.390543:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271946.390551:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea62ac0 x1820604024115456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1736271946.390563:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736271946.390563:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736271946.390565:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271946.390566:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736271946.390567:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024115392:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271946.390574:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8726 00000100:00080000:1.0:1736271946.390575:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1736271946.390578:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271946.390581:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024115456:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271946.390586:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea663c0 x1820604024115584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271946.390587:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271946.390605:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271946.390605:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115328 00000100:00100000:0.0:1736271946.390610:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024115520:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271946.390611:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271946.390613:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271946.390614:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271946.390616:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8726 00000100:00080000:1.0:1736271946.390618:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1736271946.390621:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115392 00000100:00080000:1.0:1736271946.390624:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271946.390631:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271946.390633:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea62f80 x1820604024115776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271946.390633:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1736271946.390636:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c485f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024115392:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271946.390648:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024115712:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271946.390654:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115520 00000100:00100000:2.0:1736271946.390662:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c485f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024115392:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271946.390666:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:0.0:1736271946.390669:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271946.390673:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:1.0:1736271946.390676:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c483900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024115520:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271946.390679:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736271946.390682:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:0.0:1736271946.390683:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024115648:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271946.390684:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c139c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024115328:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271946.390689:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115264 00010000:02000000:2.0:1736271946.390692:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271946.390697:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271946.390701:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c483900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024115520:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271946.390706:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1736271946.390708:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c139c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024115328:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (147us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271946.390711:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1736271946.390715:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1736271946.390718:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115712 00000100:00100000:3.0:1736271946.390718:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024115264:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271946.390726:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271946.390736:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115648 00000100:00100000:1.0:1736271946.390739:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7136 00000100:00080000:2.0:1736271946.390740:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271946.390741:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271946.390742:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c481c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024115712:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271946.390743:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024115328:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271946.390748:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7137 00000100:00100000:0.0:1736271946.390750:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c484c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024115648:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271946.390753:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024115584:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271946.390753:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024115264:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271946.390759:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1736271946.390767:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c481c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024115712:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271946.390772:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7136 00000100:00100000:2.0:1736271946.390772:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271946.390773:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c484c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024115648:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271946.390777:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7137 00000100:00100000:2.0:1736271946.390780:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea62f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024115776:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271946.390807:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115584 00000100:00100000:2.0:1736271946.390819:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271946.390820:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024115520:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271946.390823:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112845 00000100:00100000:1.0:1736271946.390826:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024115584:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271946.390829:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024115392:0@lo:400:kworker/u8:2.0 00010000:02000000:1.0:1736271946.390831:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271946.390832:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115456 00000100:00100000:2.0:1736271946.390846:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115776 00000100:00100000:0.0:1736271946.390849:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024115648:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271946.390852:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1736271946.390853:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024115584:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (80us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271946.390854:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024115456:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271946.390856:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024115712:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271946.390857:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112845 00010000:02000000:2.0:1736271946.390858:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271946.390862:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024115264:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271946.390870:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024115456:12345-0@lo:38:kworker/u8:2.0 Request processed in 15us (144us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271946.390873:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:2.0:1736271946.390878:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1736271946.390879:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024115776:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271946.390882:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271946.390888:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024115776:12345-0@lo:38:kworker/u8:2.0 Request processed in 8us (69us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271946.390895:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00080000:2.0:1736271946.390910:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271946.390911:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271946.390912:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024115584:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271946.390916:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271946.390917:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271946.390918:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea62f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024115776:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271946.390922:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271946.390923:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271946.390924:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024115456:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271947.068463:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271948.070455:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271949.072453:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271950.074486:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271950.086471:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008c8a1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024115840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271950.086471:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea60980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024115904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271950.086527:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271950.086557:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115840 00000100:00100000:3.0:1736271950.086569:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271950.086595:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5936 00000100:00100000:2.0:1736271950.086599:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4876c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024115840:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271950.086602:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115904 00000100:00100000:0.0:1736271950.086618:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5937 00000100:00100000:0.0:1736271950.086621:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024115904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271950.086621:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:0.0:1736271950.086645:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271950.086651:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4876c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024115840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271950.086656:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5936 00000100:00100000:0.0:1736271950.086670:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024115904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271950.086675:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5937 00000100:00100000:1.0:1736271950.086675:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008c8a1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024115840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271950.086687:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea60980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024115904:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271951.076455:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271951.165026:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271951.165064:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271951.165102:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058981952 00000100:00100000:0.0:1736271951.165106:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271951.165139:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982016 00000100:00100000:3.0:1736271951.165149:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 342 00000100:00100000:3.0:1736271951.165155:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058981952:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271951.165159:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982080 00000100:00100000:2.0:1736271951.165169:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1194 00000100:00100000:2.0:1736271951.165173:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c482ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058982016:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:2.0:1736271951.165184:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271951.165189:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 894 00000100:00100000:1.0:1736271951.165193:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c487200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058982080:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271951.165207:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058981952:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 52us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271951.165208:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c482ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058982016:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 34us (145us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271951.165213:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1194 00000100:00100000:3.0:1736271951.165213:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 342 00000100:00100000:1.0:1736271951.165221:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c487200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058982080:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 28us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271951.165227:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 894 00000100:00080000:1.0:1736271951.398436:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271951.398442:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271951.398445:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271951.398450:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8731 00000100:00080000:1.0:1736271951.398454:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1736271951.398458:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271951.398468:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024115968:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271951.398476:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea66880 x1820604024116032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1736271951.398512:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271951.398516:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271951.398517:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271951.398520:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8731 00000100:00080000:1.0:1736271951.398521:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1736271951.398524:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271951.398530:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea62140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024116096:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271951.398532:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea67200 x1820604024116160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271951.398532:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271951.398549:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024116032:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736271951.398551:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271951.398554:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271951.398555:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271951.398557:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8731 00000100:00100000:0.0:1736271951.398563:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736271951.398569:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1736271951.398572:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271951.398576:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271951.398581:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea62600 x1820604024116288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271951.398587:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024115968 00000100:00100000:3.0:1736271951.398590:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024116160:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271951.398597:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116096 00000100:00100000:3.0:1736271951.398603:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736271951.398604:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271951.398606:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271951.398607:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271951.398610:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8731 00000100:00080000:1.0:1736271951.398611:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1736271951.398613:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271951.398617:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024116288:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271951.398618:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1736271951.398620:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116032 00000100:00100000:1.0:1736271951.398620:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea63dc0 x1820604024116480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271951.398622:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024115968:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271951.398629:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116160 00000100:00100000:1.0:1736271951.398638:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024116224:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271951.398640:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:0.0:1736271951.398643:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c484280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024116096:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271951.398654:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024115968:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271951.398660:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1736271951.398665:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271951.398673:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c484280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024116096:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271951.398675:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271951.398677:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736271951.398678:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1736271951.398681:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024116352:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271951.398684:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116224 00000100:00100000:3.0:1736271951.398684:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024116480:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271951.398689:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1736271951.398692:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024116032:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271951.398697:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1736271951.398699:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271951.398700:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea60980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024116224:12345-0@lo:400:kworker/u8:2.0 00010000:02000000:0.0:1736271951.398702:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271951.398703:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271951.398720:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116480 00000100:00100000:1.0:1736271951.398724:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1736271951.398726:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea60980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024116224:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271951.398727:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024116032:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (152us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271951.398728:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024116160:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271951.398730:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:3.0:1736271951.398734:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00010000:02000000:1.0:1736271951.398735:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271951.398737:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024116480:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271951.398742:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1736271951.398744:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea64c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024116416:0@lo:400:kworker/u8:2.0 00010000:02000000:3.0:1736271951.398744:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271951.398771:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024116160:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (149us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271951.398774:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116352 00000100:00100000:1.0:1736271951.398777:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1736271951.398783:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271951.398797:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116416 00000100:00100000:1.0:1736271951.398797:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116288 00000100:00100000:3.0:1736271951.398797:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024116480:12345-0@lo:38:kworker/u8:2.0 Request processed in 59us (92us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271951.398803:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1736271951.398807:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024115968:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271951.398810:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7138 00000100:00100000:0.0:1736271951.398813:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea62ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024116352:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271951.398813:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112846 00000100:00100000:1.0:1736271951.398816:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a0e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024116288:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271951.398827:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:02000000:1.0:1736271951.398828:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736271951.398829:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271951.398832:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024116480:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271951.398835:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7139 00000100:00100000:2.0:1736271951.398839:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024116416:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:3.0:1736271951.398844:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271951.398846:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271951.398848:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea62ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024116352:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271951.398848:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024116032:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271951.398849:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a0e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024116288:12345-0@lo:38:kworker/u8:2.0 Request processed in 32us (174us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271951.398853:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7138 00000100:00100000:1.0:1736271951.398855:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112846 00000100:00080000:3.0:1736271951.398856:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271951.398857:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271951.398858:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024116160:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271951.398864:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024116416:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271951.398869:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7139 00000100:00080000:3.0:1736271951.398873:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271951.398875:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271951.398877:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024116288:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271951.398882:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea62140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024116096:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271951.398889:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024116352:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271951.398897:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024116224:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271951.398898:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea64c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024116416:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271952.078462:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271953.080490:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271954.082447:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271955.084419:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271955.094456:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024116608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271955.094480:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736271955.094492:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024116544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271955.094511:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271955.094537:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116608 00000100:00100000:3.0:1736271955.094573:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5938 00000100:00100000:3.0:1736271955.094577:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea62f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024116608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1736271955.094596:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:3.0:1736271955.094633:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea62f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024116608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271955.094639:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5938 00000100:00100000:1.0:1736271955.094662:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024116608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271955.094785:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271955.094834:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116544 00000100:00100000:0.0:1736271955.094868:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5939 00000100:00100000:0.0:1736271955.094871:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024116544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271955.094885:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736271955.094926:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024116544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271955.094930:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5939 00000100:00100000:3.0:1736271955.094990:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024116544:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271956.086521:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271956.172526:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271956.172568:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271956.172607:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982144 00000100:00100000:1.0:1736271956.172626:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982272 00000100:00100000:0.0:1736271956.172648:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271956.172669:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 344 00000100:00100000:2.0:1736271956.172674:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058982144:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271956.172687:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982208 00000100:00100000:1.0:1736271956.172703:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 897 00000100:00100000:0.0:1736271956.172707:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1198 00000100:00100000:1.0:1736271956.172707:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c482140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058982272:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271956.172712:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4817c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058982208:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271956.172745:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271956.172753:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058982144:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271956.172757:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c482140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058982272:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 50us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271956.172760:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 344 00000100:00100000:1.0:1736271956.172763:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 897 00000100:00100000:0.0:1736271956.172768:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4817c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058982208:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 57us (121us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271956.172774:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1198 00000100:00080000:1.0:1736271956.406524:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271956.406531:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271956.406543:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271956.406543:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024116672:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271956.406562:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8736 00000100:00080000:1.0:1736271956.406564:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:1.0:1736271956.406569:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271956.406612:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea663c0 x1820604024116736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271956.406662:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736271956.406675:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271956.406678:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271956.406689:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271956.406691:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8736 00000100:00080000:1.0:1736271956.406693:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:1.0:1736271956.406697:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271956.406704:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea66d40 x1820604024116864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271956.406708:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271956.406730:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024116800:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271956.406747:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116672 00000100:00100000:0.0:1736271956.406759:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736271956.406763:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271956.406767:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271956.406768:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271956.406771:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8736 00000100:00080000:1.0:1736271956.406772:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:1.0:1736271956.406775:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271956.406783:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024116928:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271956.406783:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1736271956.406788:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024116672:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271956.406792:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea650c0 x1820604024116992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271956.406802:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736271956.406811:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271956.406813:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271956.406814:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271956.406817:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8736 00000100:00080000:1.0:1736271956.406818:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:1.0:1736271956.406820:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271956.406823:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024116672:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271956.406827:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea63440 x1820604024117184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271956.406829:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1736271956.406840:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116800 00000100:00100000:1.0:1736271956.406858:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024117056:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271956.406876:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116928 00000100:00100000:0.0:1736271956.406899:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:1.0:1736271956.406900:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271956.406902:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c486880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024116800:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271956.406915:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024116736:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271956.406921:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117056 00000100:00100000:0.0:1736271956.406942:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c486880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024116800:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271956.406942:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7140 00000100:00100000:2.0:1736271956.406943:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271956.406945:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea604c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024117056:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271956.406947:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271956.406951:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024117120:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271956.406959:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024116864:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271956.406960:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:0.0:1736271956.406971:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116736 00000100:00100000:3.0:1736271956.406981:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea604c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024117056:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271956.406983:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:2.0:1736271956.406985:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271956.406987:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7140 00000100:00100000:0.0:1736271956.406988:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c480e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024116928:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271956.406989:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271956.406992:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024116992:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271956.406998:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117120 00000100:00100000:3.0:1736271956.407012:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7141 00000100:00100000:0.0:1736271956.407013:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c480e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024116928:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271956.407014:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271956.407015:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea65f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024117120:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271956.407018:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:1.0:1736271956.407021:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024117056:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271956.407025:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024117184:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271956.407026:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116864 00000100:00100000:0.0:1736271956.407033:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:0.0:1736271956.407036:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024116736:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271956.407040:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271956.407047:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea65f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024117120:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (59us total) trans 0 rc 0/0 00010000:02000000:0.0:1736271956.407048:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271956.407050:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024117120:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271956.407052:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7141 00000100:00100000:2.0:1736271956.407066:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117184 00000100:00100000:0.0:1736271956.407071:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024116736:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (127us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271956.407072:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:3.0:1736271956.407075:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c138e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024116864:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271956.407076:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1736271956.407080:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00010000:02000000:3.0:1736271956.407082:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271956.407084:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024117184:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271956.407085:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024116992 00010000:02000000:2.0:1736271956.407090:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271956.407101:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c138e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024116864:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (116us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271956.407102:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024116928:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271956.407105:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1736271956.407109:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024117184:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (69us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271956.407110:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024116800:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271956.407114:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1736271956.407120:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112847 00000100:00100000:1.0:1736271956.407123:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024116992:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271956.407139:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271956.407148:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00010000:02000000:1.0:1736271956.407150:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271956.407151:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024116736:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271956.407158:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271956.407160:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271956.407161:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024116864:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271956.407165:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271956.407166:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271956.407168:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024116992:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271956.407171:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271956.407172:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271956.407173:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024117184:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271956.407177:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024116992:12345-0@lo:38:kworker/u8:2.0 Request processed in 53us (163us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271956.407182:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112847 00000100:00100000:1.0:1736271956.407205:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024116672:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736271957.088535:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271958.090600:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271959.095463:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271960.094462:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271960.102747:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271960.102770:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024117248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271960.102904:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271960.102974:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117248 00000100:00100000:1.0:1736271960.103084:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736271960.103102:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024117312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271960.103137:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271960.103277:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117312 00000100:00100000:2.0:1736271960.103310:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5940 00000100:00100000:2.0:1736271960.103315:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c484740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024117248:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271960.103322:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5941 00002000:00000024:2.0:1736271960.103339:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271960.103355:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024117312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271960.103390:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271960.103391:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c484740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024117248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271960.103397:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5940 00000100:00100000:0.0:1736271960.103422:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024117312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271960.103428:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5941 00000100:00100000:1.0:1736271960.103538:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024117312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271960.103689:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024117248:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736271961.097832:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271961.180834:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271961.182987:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271961.183040:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271961.183100:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982336 00000100:00100000:2.0:1736271961.183154:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 346 00000100:00100000:2.0:1736271961.183159:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058982336:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271961.183212:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058982336:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 52us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271961.183229:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 346 00000100:00100000:1.0:1736271961.183680:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982464 00000100:00100000:1.0:1736271961.183721:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982400 00000100:00100000:1.0:1736271961.183737:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 900 00000100:00100000:1.0:1736271961.183741:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c485a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058982464:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271961.183779:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c485a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058982464:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 38us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271961.183784:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 900 00000100:00100000:1.0:1736271961.183794:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1202 00000100:00100000:1.0:1736271961.183796:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c480980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058982400:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271961.183806:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271961.183822:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c480980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1891:x1820604058982400:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 25us (783us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271961.183827:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1202 00000100:00080000:1.0:1736271961.414417:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271961.414422:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271961.414425:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271961.414431:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8741 00000100:00080000:1.0:1736271961.414434:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:1.0:1736271961.414438:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271961.414445:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024117376:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271961.414455:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea64c00 x1820604024117440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271961.414504:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736271961.414639:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271961.414642:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271961.414643:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271961.414645:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8741 00000100:00080000:1.0:1736271961.414647:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:1.0:1736271961.414649:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271961.414668:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea62600 x1820604024117568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1736271961.414704:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271961.414706:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271961.414707:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271961.414709:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8741 00000100:00080000:1.0:1736271961.414711:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:1.0:1736271961.414713:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271961.414722:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea66880 x1820604024117696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1736271961.414737:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271961.414739:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271961.414740:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271961.414742:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8741 00000100:00080000:1.0:1736271961.414743:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:1.0:1736271961.414745:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271961.414752:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea676c0 x1820604024117888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271961.414770:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024117632:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271961.414796:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271961.414817:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736271961.414821:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024117760:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271961.414840:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271961.414880:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea62140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024117504:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271961.414907:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271961.414961:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea64c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024117440:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271961.414966:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024117824:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271961.414984:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271961.414998:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117376 00000100:00100000:3.0:1736271961.415025:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1736271961.415028:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024117376:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271961.415058:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024117376:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271961.415063:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1736271961.415086:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117760 00000100:00100000:3.0:1736271961.415101:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117824 00000100:00100000:3.0:1736271961.415110:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7142 00000100:00100000:3.0:1736271961.415113:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea650c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024117760:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271961.415154:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117632 00000100:00100000:0.0:1736271961.415171:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271961.415171:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117504 00000100:00100000:2.0:1736271961.415181:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117440 00000100:00100000:0.0:1736271961.415182:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024117568:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271961.415191:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:2.0:1736271961.415194:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea63440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024117632:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271961.415197:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271961.415203:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024117696:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271961.415219:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea63440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024117632:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271961.415220:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271961.415224:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1736271961.415232:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024117888:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271961.415233:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117568 00000100:00100000:2.0:1736271961.415240:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1736271961.415242:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e4c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024117504:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271961.415244:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271961.415278:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117888 00000100:00100000:2.0:1736271961.415279:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e4c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024117504:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271961.415284:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:0.0:1736271961.415291:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1736271961.415294:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024117440:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271961.415296:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1736271961.415298:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024117568:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271961.415303:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736271961.415304:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271961.415321:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024117568:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (124us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271961.415323:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024117440:12345-0@lo:38:kworker/u8:2.0 Request processed in 29us (153us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271961.415326:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:1.0:1736271961.415368:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024117760:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271961.415375:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024117632:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271961.415401:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7143 00000100:00100000:1.0:1736271961.415405:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024117824:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271961.415426:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024117824:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271961.415431:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7143 00000100:00100000:1.0:1736271961.415447:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117696 00000100:00100000:3.0:1736271961.415489:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea650c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024117760:12345-0@lo:400:kworker/u8:2.0 Request processed in 19us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271961.415494:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7142 00000100:00100000:0.0:1736271961.415565:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1736271961.415579:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:0.0:1736271961.415582:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024117888:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271961.415588:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271961.415606:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024117888:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (362us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271961.415610:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:0.0:1736271961.415632:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea62140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024117504:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271961.415648:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271961.415650:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271961.415653:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea64c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024117440:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271961.415660:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271961.415662:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271961.415663:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024117568:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271961.415666:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024117824:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271961.415670:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736271961.415671:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024117376:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271961.415671:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271961.415673:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024117888:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271961.415734:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112848 00000100:00100000:1.0:1736271961.415738:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024117696:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271961.415743:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271961.415774:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024117696:12345-0@lo:38:kworker/u8:2.0 Request processed in 36us (554us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271961.415778:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112848 00000100:00080000:2.0:1736271961.415809:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736271961.415811:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:2.0:1736271961.415814:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024117696:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271962.098511:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271963.101185:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271964.103352:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271965.104500:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271965.111520:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d4e4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024117952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271965.111582:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736271965.111596:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011d4e50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024118016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271965.111701:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271965.111802:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271965.111995:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118016 00000100:00100000:3.0:1736271965.112038:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024117952 00000100:00100000:3.0:1736271965.112059:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5942 00000100:00100000:3.0:1736271965.112064:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024118016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1736271965.112106:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271965.112246:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5943 00000100:00100000:2.0:1736271965.112250:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024117952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271965.112299:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271965.112333:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024117952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271965.112339:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5943 00000100:00100000:2.0:1736271965.112391:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d4e4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024117952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271965.112576:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024118016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 511us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271965.112707:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011d4e50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024118016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271965.112870:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5942 00010000:00010000:1.0:1736271966.106545:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271966.189559:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736271966.189780:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982528 00000100:00100000:3.0:1736271966.190070:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 348 00000100:00100000:3.0:1736271966.190076:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058982528:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271966.190137:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058982528:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 62us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271966.190143:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 348 00000100:00100000:0.0:1736271966.191832:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271966.191918:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271966.191968:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982656 00000100:00100000:2.0:1736271966.192005:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982592 00000100:00100000:2.0:1736271966.192022:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 903 00000100:00100000:2.0:1736271966.192025:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058982656:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271966.192060:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058982656:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 35us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271966.192065:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 903 00000100:00100000:2.0:1736271966.192076:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1206 00000100:00100000:2.0:1736271966.192078:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058982592:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:2.0:1736271966.192088:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736271966.192101:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058982592:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 22us (184us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271966.192105:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1206 00000100:00080000:1.0:1736271966.422847:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271966.422852:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271966.422855:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271966.422859:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8746 00000100:00080000:1.0:1736271966.422862:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:1.0:1736271966.422866:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271966.422878:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea63dc0 x1820604024118144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736271966.422885:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024118080:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736271966.422905:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271966.422917:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271966.422918:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271966.422919:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8746 00000100:00080000:1.0:1736271966.422920:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:1.0:1736271966.422923:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271966.422928:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea663c0 x1820604024118272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1736271966.422935:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271966.422937:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271966.422938:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271966.422939:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8746 00000100:00080000:1.0:1736271966.422940:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:1.0:1736271966.422941:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271966.422946:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea61c80 x1820604024118400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1736271966.422956:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271966.422958:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271966.422958:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271966.422960:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8746 00000100:00080000:1.0:1736271966.422961:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:2.0:1736271966.422961:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736271966.422962:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271966.422966:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea62600 x1820604024118592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271966.422982:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024118208:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271966.422989:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024118528:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271966.423013:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271966.423016:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271966.423029:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736271966.423030:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736271966.423032:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024118336:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271966.423034:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024118464:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271966.423045:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271966.423055:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271966.423065:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118208 00000100:00100000:1.0:1736271966.423084:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118336 00000100:00100000:2.0:1736271966.423085:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118528 00000100:00100000:1.0:1736271966.423093:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1736271966.423096:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024118208:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271966.423104:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118464 00000100:00100000:2.0:1736271966.423115:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7144 00000100:00100000:1.0:1736271966.423118:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024118208:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271966.423118:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024118528:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271966.423121:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1736271966.423130:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1736271966.423131:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea64c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024118336:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271966.423141:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea64c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024118336:12345-0@lo:400:kworker/u8:2.0 Request processed in 10us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271966.423144:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1736271966.423148:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024118528:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271966.423157:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7145 00000100:00100000:1.0:1736271966.423158:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024118464:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271966.423162:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7144 00000100:00100000:1.0:1736271966.423168:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024118464:12345-0@lo:400:kworker/u8:2.0 Request processed in 9us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271966.423171:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7145 00000100:00100000:2.0:1736271966.423197:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024118464:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271966.423250:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118080 00000100:00100000:0.0:1736271966.423287:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1736271966.423290:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024118080:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271966.423364:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024118144:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271966.423736:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024118336:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271966.423743:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024118208:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271966.423768:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024118528:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271966.424925:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024118080:12345-0@lo:400:kworker/u8:2.0 Request processed in 1632us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271966.424931:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1736271966.425001:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024118080:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271966.425050:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271966.425647:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024118272:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271966.425677:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271966.425701:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024118400:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271966.425719:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271966.425730:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024118592:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271966.425744:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271966.426090:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118400 00000100:00100000:3.0:1736271966.426109:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112849 00000100:00100000:3.0:1736271966.426112:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a04c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024118400:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271966.426131:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271966.426155:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a04c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024118400:12345-0@lo:38:kworker/u8:2.0 Request processed in 42us (435us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271966.426160:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112849 00000100:00080000:3.0:1736271966.426180:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271966.426183:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271966.426185:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024118400:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271966.426281:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118144 00000100:00100000:1.0:1736271966.426296:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118272 00000100:00100000:1.0:1736271966.426305:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118592 00000100:00100000:1.0:1736271966.426314:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:1.0:1736271966.426321:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024118144:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271966.426326:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271966.426357:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024118144:12345-0@lo:38:kworker/u8:2.0 Request processed in 36us (1308us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271966.426362:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:1.0:1736271966.426371:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:1.0:1736271966.426373:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024118272:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271966.426377:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271966.426391:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024118272:12345-0@lo:38:kworker/u8:2.0 Request processed in 18us (715us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271966.426395:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:1.0:1736271966.426401:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:1.0:1736271966.426403:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024118592:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271966.426407:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271966.426418:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024118592:12345-0@lo:38:kworker/u8:2.0 Request processed in 14us (674us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271966.426421:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00080000:3.0:1736271966.426664:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271966.426667:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271966.426670:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024118144:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271966.426677:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271966.426679:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271966.426680:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024118272:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271966.426686:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271966.426687:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271966.426689:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024118592:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271967.109074:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271968.110453:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271969.112478:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271970.114465:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271970.118552:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1736271970.118568:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024118656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271970.118621:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271970.118659:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024118720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271970.118672:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271970.118703:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118656 00000100:00100000:2.0:1736271970.118740:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118720 00000100:00100000:2.0:1736271970.118751:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5944 00000100:00100000:2.0:1736271970.118756:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024118656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271970.118776:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736271970.118780:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5945 00000100:00100000:3.0:1736271970.118785:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024118720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1736271970.118800:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271970.118803:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024118656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271970.118808:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5944 00000100:00100000:3.0:1736271970.118824:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024118720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271970.118829:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5945 00000100:00100000:2.0:1736271970.118840:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024118656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271970.118849:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024118720:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736271971.116662:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271971.197138:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271971.197217:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982848 00000100:00100000:0.0:1736271971.197382:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271971.197450:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271971.197470:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982720 00000100:00100000:2.0:1736271971.197496:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982784 00000100:00100000:0.0:1736271971.197499:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 350 00000100:00100000:0.0:1736271971.197503:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058982720:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271971.197526:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 906 00000100:00100000:2.0:1736271971.197529:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058982848:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271971.197809:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058982720:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 46us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271971.197829:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058982848:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271971.197855:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 350 00000100:00100000:1.0:1736271971.197871:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1210 00000100:00100000:1.0:1736271971.197875:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058982784:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:1.0:1736271971.197885:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271971.197905:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058982784:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 30us (456us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271971.197961:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 906 00000100:00100000:1.0:1736271971.198198:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1210 00000100:00080000:1.0:1736271971.430785:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271971.430790:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271971.430792:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271971.430798:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8751 00000100:00080000:1.0:1736271971.430801:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:1.0:1736271971.430805:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271971.430821:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea64740 x1820604024118848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1736271971.430852:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271971.430855:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271971.430856:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271971.430858:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8751 00000100:00080000:1.0:1736271971.430859:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:1.0:1736271971.430862:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271971.430870:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea66d40 x1820604024118976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1736271971.430880:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271971.430883:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271971.430883:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271971.430885:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8751 00000100:00080000:1.0:1736271971.430887:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:1.0:1736271971.430889:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271971.430895:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea663c0 x1820604024119104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1736271971.430909:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1736271971.430921:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1736271971.430921:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736271971.430924:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8751 00000100:00080000:1.0:1736271971.430925:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:1.0:1736271971.430927:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271971.430935:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88011ea67200 x1820604024119296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271971.430964:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea62140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024118912:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271971.431015:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024119168:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271971.431018:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271971.431039:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271971.431042:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736271971.431045:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024119040:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271971.431055:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1736271971.431059:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024118784:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271971.431059:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271971.431078:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271971.431082:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118912 00000100:00100000:0.0:1736271971.431085:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024119232:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271971.431097:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271971.431105:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119040 00000100:00100000:0.0:1736271971.431113:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119168 00000100:00100000:1.0:1736271971.431117:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:1.0:1736271971.431121:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea676c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024118912:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271971.431128:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119232 00000100:00100000:0.0:1736271971.431138:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7146 00000100:00100000:0.0:1736271971.431140:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024119168:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271971.431149:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea676c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024118912:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271971.431154:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1736271971.431158:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024119168:12345-0@lo:400:kworker/u8:2.0 Request processed in 18us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271971.431162:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7146 00000100:00100000:1.0:1736271971.431164:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:1.0:1736271971.431166:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea66880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024119040:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271971.431170:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7147 00000100:00100000:0.0:1736271971.431172:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d4e4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024119232:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271971.431179:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea66880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024119040:12345-0@lo:400:kworker/u8:2.0 Request processed in 12us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271971.431183:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:0.0:1736271971.431185:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d4e4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024119232:12345-0@lo:400:kworker/u8:2.0 Request processed in 12us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271971.431189:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7147 00000100:00100000:0.0:1736271971.431200:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118784 00000100:00100000:1.0:1736271971.431207:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024119040:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271971.431221:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea62140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024118912:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271971.431222:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1736271971.431224:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024118784:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271971.431241:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024118784:12345-0@lo:400:kworker/u8:2.0 Request processed in 17us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271971.431246:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1736271971.431280:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024118784:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271971.431288:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024119232:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271971.431293:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024119168:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271971.431557:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024118848:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271971.431578:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271971.431604:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024118976:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271971.431627:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271971.431647:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024119104:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271971.431664:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271971.431686:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024119296:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271971.431700:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271971.431710:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118848 00000100:00100000:1.0:1736271971.431721:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024118976 00000100:00100000:1.0:1736271971.431728:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119296 00000100:00100000:1.0:1736271971.431736:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1736271971.431739:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024118848:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271971.431747:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271971.431754:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119104 00000100:00100000:2.0:1736271971.431801:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112850 00000100:00100000:2.0:1736271971.431805:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024119104:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271971.431810:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271971.431839:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024118848:12345-0@lo:38:kworker/u8:2.0 Request processed in 99us (260us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271971.431843:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1736271971.431852:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:1.0:1736271971.431854:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024118976:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271971.431859:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271971.431922:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024119104:12345-0@lo:38:kworker/u8:2.0 Request processed in 116us (257us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271971.431927:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112850 00000100:00100000:2.0:1736271971.431948:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:2.0:1736271971.431950:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024119296:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271971.431954:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271971.431968:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024119296:12345-0@lo:38:kworker/u8:2.0 Request processed in 17us (268us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271971.431971:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1736271971.432008:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024118976:12345-0@lo:38:kworker/u8:2.0 Request processed in 152us (389us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736271971.432008:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271971.432010:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271971.432012:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:3.0:1736271971.432012:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024118848:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271971.432020:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271971.432021:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271971.432023:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024118976:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271971.432028:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271971.432030:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271971.432031:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024119104:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271971.432036:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271971.432037:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271971.432039:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024119296:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271972.118711:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271973.121458:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271974.122441:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736271975.124457:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271975.126494:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024119360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271975.126521:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024119424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271975.126550:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271975.126641:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271975.126680:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119360 00000100:00100000:2.0:1736271975.126732:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119424 00000100:00100000:2.0:1736271975.126750:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5946 00000100:00100000:2.0:1736271975.126755:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024119360:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271975.126778:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5947 00002000:00000024:2.0:1736271975.126783:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736271975.126785:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea62140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024119424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1736271975.126818:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271975.126841:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024119360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271975.126848:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5946 00000100:00100000:0.0:1736271975.126869:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024119360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271975.126875:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea62140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024119424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271975.126886:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5947 00000100:00100000:1.0:1736271975.126955:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024119424:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736271976.126468:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271976.204578:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271976.204638:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271976.204641:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982912 00000100:00100000:0.0:1736271976.204673:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736271976.204679:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 352 00000100:00100000:2.0:1736271976.204683:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058982912:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271976.204694:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983040 00000100:00100000:1.0:1736271976.204702:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058982976 00000100:00100000:0.0:1736271976.204716:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 909 00000100:00100000:0.0:1736271976.204719:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058983040:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736271976.204733:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1214 00000100:00100000:2.0:1736271976.204733:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058982912:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 49us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271976.204737:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc284c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058982976:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:2.0:1736271976.204739:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 352 00000100:00100000:0.0:1736271976.204743:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058983040:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 23us (106us total) trans 0 rc 0/0 00010000:02000000:1.0:1736271976.204746:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271976.204748:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 909 00000100:00100000:1.0:1736271976.204771:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc284c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1891:x1820604058982976:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 34us (99us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271976.204776:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1214 00000100:00080000:2.0:1736271976.438476:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271976.438479:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271976.438481:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271976.438486:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8756 00000100:00080000:2.0:1736271976.438489:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271976.438493:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271976.438508:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024119488:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271976.438509:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13b900 x1820604024119552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271976.438534:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024119552:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271976.438536:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271976.438539:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271976.438540:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271976.438542:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8756 00000100:00080000:2.0:1736271976.438544:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1736271976.438544:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024119616:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271976.438547:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271976.438554:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009c13d0c0 x1820604024119680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271976.438565:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271976.438581:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271976.438582:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271976.438599:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271976.438600:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271976.438603:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8756 00000100:00080000:2.0:1736271976.438613:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271976.438616:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271976.438626:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009cb13900 x1820604024119808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271976.438640:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024119744:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271976.438649:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271976.438652:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271976.438653:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271976.438653:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1736271976.438655:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8756 00000100:00080000:2.0:1736271976.438656:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271976.438659:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271976.438659:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024119936:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271976.438664:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271976.438667:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009cb15580 x1820604024120000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271976.438678:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271976.438680:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736271976.438684:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024119872:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271976.438698:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271976.438700:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119616 00000100:00100000:1.0:1736271976.438702:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271976.438718:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119744 00000100:00100000:1.0:1736271976.438722:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119488 00000100:00100000:2.0:1736271976.438738:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119552 00000100:00100000:3.0:1736271976.438740:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1736271976.438742:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1736271976.438745:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024119488:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271976.438745:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024119616:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271976.438747:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:2.0:1736271976.438750:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea62600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024119744:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271976.438780:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea62600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024119744:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271976.438780:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024119616:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271976.438784:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:1.0:1736271976.438785:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024119488:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271976.438786:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1736271976.438790:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1736271976.438792:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1736271976.438793:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024119552:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271976.438794:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024119488:0@lo:400:kworker/u8:2.0 00010000:02000000:2.0:1736271976.438800:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271976.438808:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024119616:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271976.438812:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024119552:12345-0@lo:38:kworker/u8:2.0 Request processed in 18us (114us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271976.438815:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024119744:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271976.438815:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:0.0:1736271976.438818:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119936 00000100:00100000:3.0:1736271976.438820:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024119680:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271976.438835:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119872 00000100:00100000:3.0:1736271976.438835:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271976.438837:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7148 00000100:00100000:1.0:1736271976.438840:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024119936:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271976.438844:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7149 00000100:00100000:3.0:1736271976.438845:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024119808:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271976.438846:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea67200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024119872:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271976.438846:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119680 00000100:00100000:2.0:1736271976.438858:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1736271976.438860:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024119680:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271976.438862:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:2.0:1736271976.438863:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271976.438879:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea67200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024119872:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271976.438879:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024119936:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271976.438881:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024119680:12345-0@lo:38:kworker/u8:2.0 Request processed in 19us (45us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271976.438883:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7149 00000100:00100000:3.0:1736271976.438884:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024119936:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271976.438885:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7148 00000100:00100000:2.0:1736271976.438885:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1736271976.438896:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb15580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024120000:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271976.438901:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024119808 00000100:00100000:1.0:1736271976.438903:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024119872:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271976.438920:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112851 00000100:00100000:2.0:1736271976.438923:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a3900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024119808:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271976.438928:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271976.438935:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271976.438945:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a3900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024119808:12345-0@lo:38:kworker/u8:2.0 Request processed in 21us (82us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271976.438949:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112851 00000100:00080000:3.0:1736271976.438960:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736271976.438962:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120000 00000100:00080000:3.0:1736271976.438962:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271976.438964:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024119552:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271976.438971:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:2.0:1736271976.438973:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c8a2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024120000:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271976.438977:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:02000000:2.0:1736271976.438978:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736271976.438979:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271976.438981:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024119680:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271976.438986:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271976.438988:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271976.438990:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024119808:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271976.438995:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c8a2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024120000:12345-0@lo:38:kworker/u8:2.0 Request processed in 20us (60us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736271976.438995:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271976.438997:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271976.438998:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb15580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024120000:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271976.438999:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00010000:00010000:2.0:1736271977.128448:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271978.130449:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271979.132618:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271980.134401:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1736271980.134412:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736271980.134413:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736271980.134416:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024120064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736271980.134434:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024120128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271980.134480:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271980.134504:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120064 00000100:00100000:3.0:1736271980.134512:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271980.134532:0:9278:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120128 00000100:00100000:1.0:1736271980.134542:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5948 00000100:00100000:1.0:1736271980.134546:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea66d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024120064:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271980.134547:0:1876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5949 00000100:00100000:0.0:1736271980.134551:0:1876:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024120128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736271980.134580:0:1876:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:1.0:1736271980.134591:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:0.0:1736271980.134617:0:1876:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024120128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271980.134621:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea66d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024120064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271980.134622:0:1876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5949 00000100:00100000:1.0:1736271980.134625:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5948 00000100:00100000:3.0:1736271980.134643:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024120128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271980.134646:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024120064:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736271981.136482:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271981.212410:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271981.212446:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271981.212481:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271981.212484:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983104 00000100:00100000:2.0:1736271981.212507:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983232 00000100:00100000:1.0:1736271981.212519:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 354 00000100:00100000:1.0:1736271981.212524:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058983104:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271981.212532:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983168 00000100:00100000:0.0:1736271981.212534:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 912 00000100:00100000:0.0:1736271981.212537:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058983232:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271981.212543:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1218 00000100:00100000:3.0:1736271981.212548:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058983168:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:1.0:1736271981.212588:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058983104:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 63us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271981.212589:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058983232:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 51us (143us total) trans 0 rc 0/0 00010000:02000000:3.0:1736271981.212589:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271981.212594:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 912 00000100:00100000:1.0:1736271981.212594:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 354 00000100:00100000:3.0:1736271981.212618:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058983168:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 69us (137us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271981.212624:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1218 00000100:00080000:2.0:1736271981.446784:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271981.446800:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271981.446803:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271981.446807:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8761 00000100:00080000:2.0:1736271981.446810:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271981.446814:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271981.446832:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009cb10e40 x1820604024120256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271981.446863:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024120192:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271981.446868:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271981.446871:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271981.446872:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271981.446874:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8761 00000100:00080000:2.0:1736271981.446875:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271981.446878:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271981.446885:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009cb15580 x1820604024120384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271981.446896:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271981.446898:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271981.446899:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271981.446901:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8761 00000100:00080000:2.0:1736271981.446903:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271981.446905:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271981.446911:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024120320:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271981.446912:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009cb11300 x1820604024120512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271981.446936:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271981.446949:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271981.446960:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736271981.446964:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024120576:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271981.446965:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736271981.446970:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024120448:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271981.446983:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271981.446987:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271981.446991:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120192 00000100:00100000:3.0:1736271981.447006:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120320 00000100:00100000:1.0:1736271981.447007:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120448 00000100:00100000:0.0:1736271981.447017:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1736271981.447021:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024120192:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271981.447026:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1736271981.447030:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:3.0:1736271981.447030:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea663c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024120320:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271981.447033:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea64740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024120448:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271981.447064:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea64740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024120448:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (77us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271981.447064:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea663c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3335:x1820604024120320:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271981.447068:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3334:x1820604024120192:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271981.447068:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:0.0:1736271981.447073:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1736271981.447074:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:3.0:1736271981.447089:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da43bf2a-6599-41e6-baa1-4103623ce0d4:3334:1820604024120192:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271981.447095:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120576 00000100:00100000:3.0:1736271981.447100:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb10e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024120256:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271981.447103:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024120448:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271981.447110:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3335:1820604024120320:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271981.447111:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7150 00000100:00100000:0.0:1736271981.447114:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024120576:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271981.447116:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271981.447125:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120256 00000100:00100000:3.0:1736271981.447129:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb15580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024120384:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271981.447145:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1736271981.447147:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024120256:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271981.447156:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271981.447174:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024120256:12345-0@lo:38:kworker/u8:2.0 Request processed in 26us (58us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271981.447178:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:0.0:1736271981.447327:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024120576:12345-0@lo:400:kworker/u8:2.0 Request processed in 211us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271981.447332:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7150 00000100:00080000:2.0:1736271981.447339:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271981.447342:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1736271981.447346:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024120640:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271981.447347:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271981.447350:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8761 00000100:00080000:2.0:1736271981.447351:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736271981.447354:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271981.447362:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271981.447364:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009cb13dc0 x1820604024120704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271981.447381:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024120576:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271981.447395:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120640 00000100:00100000:3.0:1736271981.447399:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271981.447409:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7151 00000100:00100000:0.0:1736271981.447412:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024120640:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271981.447417:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024120512:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271981.447432:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271981.447440:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024120640:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271981.447444:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024120704:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271981.447445:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7151 00000100:00100000:1.0:1736271981.447452:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024120640:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271981.447455:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271981.447465:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120512 00000100:00080000:3.0:1736271981.447466:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271981.447468:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271981.447469:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120384 00000100:00100000:3.0:1736271981.447473:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb10e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024120256:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271981.447477:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112852 00000100:00100000:0.0:1736271981.447479:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d17c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024120512:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271981.447479:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120704 00010000:02000000:0.0:1736271981.447485:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271981.447493:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:1.0:1736271981.447496:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024120384:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271981.447497:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:3.0:1736271981.447500:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024120704:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271981.447502:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271981.447504:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d17c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024120512:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (71us total) trans 0 rc -19/-19 00010000:02000000:3.0:1736271981.447506:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271981.447508:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112852 00000100:00100000:1.0:1736271981.447520:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024120384:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (120us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271981.447524:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1736271981.447524:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3332:x1820604024120704:12345-0@lo:38:kworker/u8:2.0 Request processed in 23us (68us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271981.447529:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00080000:3.0:1736271981.447543:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271981.447544:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271981.447546:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024120704:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271981.447570:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271981.447572:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271981.447574:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb15580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024120384:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271981.447580:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271981.447581:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271981.447583:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024120512:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271982.138650:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271983.140666:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271984.142477:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271985.142448:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024120832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736271985.142448:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88011ea63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024120768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271985.142502:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271985.142551:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120832 00000100:00100000:2.0:1736271985.142578:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5950 00000100:00100000:2.0:1736271985.142580:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024120832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736271985.142597:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736271985.142620:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024120832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271985.142623:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5950 00000100:00100000:3.0:1736271985.142626:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271985.142643:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120768 00000100:00100000:2.0:1736271985.142652:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5951 00000100:00100000:2.0:1736271985.142653:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024120768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271985.142661:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271985.142672:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024120768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 19us (48us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271985.142675:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5951 00000100:00100000:3.0:1736271985.142693:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88011ea63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024120768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736271985.142758:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024120832:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271985.144387:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271986.146417:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271986.220484:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271986.220553:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271986.220589:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983296 00000100:00100000:0.0:1736271986.220608:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271986.220622:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 356 00000100:00100000:1.0:1736271986.220627:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058983296:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736271986.220664:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983424 00000100:00100000:2.0:1736271986.220665:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983360 00000100:00100000:1.0:1736271986.220693:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058983296:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 65us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271986.220698:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 356 00000100:00100000:2.0:1736271986.220725:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 915 00000100:00100000:2.0:1736271986.220728:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc29c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058983424:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271986.220755:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc29c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058983424:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 27us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271986.220755:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1222 00000100:00100000:2.0:1736271986.220759:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 915 00000100:00100000:3.0:1736271986.220759:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc28980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058983360:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736271986.220770:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:3.0:1736271986.220791:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc28980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058983360:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 32us (183us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271986.220803:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1222 00000100:00080000:2.0:1736271986.454418:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271986.454425:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271986.454427:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271986.454432:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8766 00000100:00080000:2.0:1736271986.454435:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271986.454440:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271986.454454:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024120896:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271986.454460:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009cb104c0 x1820604024120960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271986.454486:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271986.454489:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271986.454490:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271986.454492:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8766 00000100:00080000:2.0:1736271986.454493:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00100000:0.0:1736271986.454494:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024121024:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271986.454496:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271986.454503:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009cb15580 x1820604024121088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271986.454514:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271986.454517:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024120960:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271986.454537:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736271986.454540:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271986.454540:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271986.454541:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736271986.454541:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1736271986.454543:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8766 00000100:00080000:2.0:1736271986.454544:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736271986.454547:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271986.454550:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024121152:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271986.454565:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009cb10e40 x1820604024121216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271986.454567:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120896 00000100:00100000:3.0:1736271986.454571:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271986.454585:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024121280:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271986.454586:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121024 00000100:00080000:2.0:1736271986.454586:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271986.454588:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271986.454589:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271986.454591:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8766 00000100:00080000:2.0:1736271986.454592:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00100000:1.0:1736271986.454593:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00080000:2.0:1736271986.454595:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271986.454597:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024120896:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271986.454600:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271986.454601:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084660e40 x1820604024121408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271986.454605:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121152 00000100:00100000:0.0:1736271986.454618:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:3.0:1736271986.454619:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121280 00000100:00100000:0.0:1736271986.454622:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc29300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024121024:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271986.454623:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1736271986.454626:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024120896:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271986.454626:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024121152:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271986.454631:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1736271986.454636:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7152 00000100:00100000:3.0:1736271986.454639:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024121280:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271986.454646:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc29300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3334:x1820604024121024:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271986.454650:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1736271986.454656:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024121344:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271986.454657:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024121152:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271986.454657:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024121280:12345-0@lo:400:kworker/u8:2.0 Request processed in 18us (57us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271986.454661:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7152 00000100:00100000:2.0:1736271986.454662:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:0.0:1736271986.454678:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3334:1820604024121024:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271986.454680:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271986.454687:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024121280:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271986.454694:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024120896:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271986.454694:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024121152:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271986.454709:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121344 00000100:00100000:3.0:1736271986.454722:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271986.454728:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7153 00000100:00100000:1.0:1736271986.454730:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea61c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024121344:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271986.454746:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb15580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024121088:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271986.454752:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea61c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024121344:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271986.454756:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7153 00000100:00100000:3.0:1736271986.454759:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271986.454770:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024121344:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271986.454773:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb10e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024121216:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271986.454788:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271986.454801:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084660e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024121408:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271986.454809:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121216 00000100:00100000:3.0:1736271986.454812:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271986.454823:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112853 00000100:00100000:1.0:1736271986.454826:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024121216:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271986.454826:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024120960 00010000:02000000:1.0:1736271986.454840:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271986.454840:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121088 00000100:00100000:2.0:1736271986.454850:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121408 00000100:00100000:2.0:1736271986.454864:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:2.0:1736271986.454867:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024120960:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:2.0:1736271986.454873:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271986.454877:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024121216:12345-0@lo:38:kworker/u8:2.0 Request processed in 50us (88us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271986.454883:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112853 00000100:00100000:3.0:1736271986.454887:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:2.0:1736271986.454891:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024120960:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (169us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271986.454895:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024121088:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271986.454896:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1736271986.454901:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00010000:02000000:3.0:1736271986.454901:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271986.454904:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024121408:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271986.454909:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271986.454919:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024121088:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (160us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271986.454923:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1736271986.454926:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024121408:12345-0@lo:38:kworker/u8:2.0 Request processed in 22us (113us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271986.454931:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00080000:3.0:1736271986.454941:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271986.454943:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271986.454946:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb10e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024121216:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271986.454952:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271986.454953:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271986.454954:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084660e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024121408:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271986.454960:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271986.454961:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271986.454962:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024120960:0@lo:38:kworker/u8:2.0 00000100:00080000:3.0:1736271986.454967:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271986.454968:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271986.454970:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb15580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024121088:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271987.148437:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271988.150414:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271989.152415:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736271990.150394:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736271990.150396:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736271990.150409:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024121536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736271990.150409:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024121472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271990.150459:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271990.150503:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121472 00000100:00100000:0.0:1736271990.150517:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271990.150537:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5952 00000100:00100000:3.0:1736271990.150542:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121536 00000100:00100000:2.0:1736271990.150548:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024121472:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271990.150559:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5953 00000100:00100000:3.0:1736271990.150562:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024121536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271990.150569:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:3.0:1736271990.150574:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271990.150596:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024121472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271990.150600:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5952 00000100:00100000:3.0:1736271990.150603:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024121536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271990.150608:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5953 00000100:00100000:0.0:1736271990.150613:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024121472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736271990.150618:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800899d1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024121536:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736271990.154422:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271991.156448:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271991.228526:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271991.228558:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271991.228595:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271991.228614:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983488 00000100:00100000:0.0:1736271991.228622:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983616 00000100:00100000:2.0:1736271991.228622:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983552 00000100:00100000:2.0:1736271991.228650:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 918 00000100:00100000:2.0:1736271991.228654:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058983616:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271991.228661:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1226 00000100:00100000:1.0:1736271991.228663:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 358 00000100:00100000:0.0:1736271991.228665:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058983552:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:1.0:1736271991.228668:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058983488:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00010000:02000000:0.0:1736271991.228680:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736271991.228711:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1891:x1820604058983552:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 45us (151us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271991.228713:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058983616:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271991.228718:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 918 00000100:00100000:1.0:1736271991.228723:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058983488:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 55us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271991.228724:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1226 00000100:00100000:1.0:1736271991.228730:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 358 00000100:00080000:2.0:1736271991.462388:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271991.462392:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271991.462394:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271991.462398:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8771 00000100:00080000:2.0:1736271991.462401:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271991.462404:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271991.462415:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084662140 x1820604024121664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271991.462422:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024121600:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271991.462434:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084662140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024121664:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736271991.462437:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271991.462440:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271991.462441:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271991.462446:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8771 00000100:00080000:2.0:1736271991.462448:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271991.462460:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271991.462469:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084664740 x1820604024121792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271991.462473:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271991.462474:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271991.462481:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271991.462482:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084662ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024121728:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271991.462483:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271991.462484:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271991.462496:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8771 00000100:00080000:2.0:1736271991.462497:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736271991.462500:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736271991.462507:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800846650c0 x1820604024121920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271991.462512:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084664740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024121792:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271991.462515:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271991.462526:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121664 00000100:00100000:1.0:1736271991.462526:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736271991.462531:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084664c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024121856:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271991.462533:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736271991.462533:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084665580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024121984:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271991.462535:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271991.462535:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271991.462537:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8771 00000100:00080000:2.0:1736271991.462539:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00100000:0.0:1736271991.462541:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121728 00000100:00080000:2.0:1736271991.462541:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736271991.462544:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271991.462547:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084661300 x1820604024122112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271991.462551:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271991.462556:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121856 00000100:00100000:2.0:1736271991.462563:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084665f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024122048:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271991.462565:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:0.0:1736271991.462567:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea61300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024121728:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271991.462575:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:3.0:1736271991.462579:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ea63dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024121856:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271991.462580:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271991.462584:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:1.0:1736271991.462587:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024121664:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271991.462596:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea61300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024121728:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (81us total) trans 0 rc 0/0 00010000:02000000:1.0:1736271991.462597:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271991.462598:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ea63dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024121856:12345-0@lo:400:kworker/u8:2.0 Request processed in 19us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271991.462601:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:3.0:1736271991.462603:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:2.0:1736271991.462615:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121984 00000100:00100000:0.0:1736271991.462618:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121600 00000100:00100000:3.0:1736271991.462619:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271991.462622:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024121664:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (148us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271991.462626:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1736271991.462627:0:27147:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121792 00000100:00100000:2.0:1736271991.462631:0:23098:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122048 00000100:00100000:0.0:1736271991.462635:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1736271991.462635:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:3.0:1736271991.462637:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024121792:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271991.462638:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024121600:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271991.462641:0:23098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7154 00010000:02000000:3.0:1736271991.462641:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271991.462644:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7155 00000100:00100000:2.0:1736271991.462644:0:23098:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024121984:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271991.462646:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084661c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024122048:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271991.462652:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024121792:12345-0@lo:38:kworker/u8:2.0 Request processed in 15us (33us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271991.462655:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:0.0:1736271991.462663:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024121600:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1736271991.462667:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084661c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024122048:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271991.462668:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00080000:3.0:1736271991.462670:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736271991.462671:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7155 00000100:00080000:3.0:1736271991.462672:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271991.462674:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084662140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024121664:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271991.462676:0:23098:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024121984:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271991.462684:0:23098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7154 00000100:00100000:3.0:1736271991.462689:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084665580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024121984:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271991.462690:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084664c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024121856:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271991.462697:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084662ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024121728:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271991.462700:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084665f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024122048:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271991.462703:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024121920:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271991.462708:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024121600:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271991.462720:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271991.462729:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084661300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024122112:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271991.462734:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024121920 00000100:00100000:3.0:1736271991.462742:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271991.462755:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112854 00000100:00100000:1.0:1736271991.462757:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024121920:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271991.462761:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736271991.462764:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271991.462765:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271991.462768:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122112 00000100:00100000:3.0:1736271991.462768:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084664740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024121792:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271991.462774:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024121920:12345-0@lo:38:kworker/u8:2.0 Request processed in 17us (55us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271991.462777:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112854 00000100:00080000:3.0:1736271991.462778:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271991.462779:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271991.462781:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024121920:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271991.462782:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:0.0:1736271991.462784:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024122112:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736271991.462788:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271991.462803:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024122112:12345-0@lo:38:kworker/u8:2.0 Request processed in 19us (61us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736271991.462806:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00080000:3.0:1736271991.462809:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736271991.462811:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:3.0:1736271991.462813:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084661300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024122112:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271992.158408:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271993.160430:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271994.162452:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736271995.158419:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc2cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024122240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736271995.158420:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008cef6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024122176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271995.158499:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271995.158544:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271995.158627:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122240 00000100:00100000:3.0:1736271995.158627:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122176 00000100:00100000:2.0:1736271995.158665:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5954 00000100:00100000:2.0:1736271995.158669:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b16880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024122240:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736271995.158678:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5955 00000100:00100000:3.0:1736271995.158681:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024122176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736271995.158690:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:3.0:1736271995.158698:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736271995.158721:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b16880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024122240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271995.158724:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024122176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271995.158726:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5954 00000100:00100000:3.0:1736271995.158728:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5955 00000100:00100000:0.0:1736271995.158738:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008cef6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024122176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736271995.158739:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc2cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024122240:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736271995.164484:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271996.166581:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736271996.236487:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271996.236534:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736271996.236573:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1736271996.236671:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983680 00000100:00100000:2.0:1736271996.236673:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983808 00000100:00100000:2.0:1736271996.236710:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983744 00000100:00100000:1.0:1736271996.236717:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 360 00000100:00100000:1.0:1736271996.236724:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058983680:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1736271996.236724:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 921 00000100:00100000:2.0:1736271996.236729:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058983808:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736271996.236742:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1230 00000100:00100000:0.0:1736271996.236747:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058983744:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:0.0:1736271996.236758:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736271996.236795:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058983680:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 71us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1736271996.236796:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058983808:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 66us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271996.236800:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058983744:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 53us (227us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271996.236802:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 921 00000100:00100000:0.0:1736271996.236805:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1230 00000100:00100000:1.0:1736271996.236807:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 360 00000100:00080000:2.0:1736271996.470436:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271996.470441:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271996.470443:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271996.470447:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8776 00000100:00080000:2.0:1736271996.470450:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271996.470477:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736271996.470486:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024122304:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271996.470494:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084665f00 x1820604024122368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736271996.470526:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271996.470529:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271996.470530:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271996.470532:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8776 00000100:00080000:2.0:1736271996.470534:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271996.470537:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271996.470539:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084665f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024122368:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271996.470546:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084667200 x1820604024122496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736271996.470547:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271996.470569:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024122432:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271996.470570:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271996.470592:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084667200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024122496:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271996.470596:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122368 00000100:00080000:2.0:1736271996.470609:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736271996.470611:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736271996.470612:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736271996.470612:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271996.470614:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8776 00000100:00080000:2.0:1736271996.470616:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736271996.470618:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271996.470621:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084661300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024122560:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271996.470624:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122432 00000100:00100000:2.0:1736271996.470627:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800846650c0 x1820604024122624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736271996.470640:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271996.470641:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:3.0:1736271996.470645:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b17200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024122432:12345-0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736271996.470646:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736271996.470647:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122304 00000100:00080000:2.0:1736271996.470648:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736271996.470648:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736271996.470651:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8776 00000100:00080000:2.0:1736271996.470652:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:0.0:1736271996.470654:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1736271996.470654:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736271996.470658:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084664740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024122688:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736271996.470666:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084664c00 x1820604024122816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736271996.470668:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1736271996.470671:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024122304:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271996.470677:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b17200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024122432:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (65us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271996.470678:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271996.470682:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:2.0:1736271996.470688:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122560 00000100:00100000:3.0:1736271996.470692:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1736271996.470695:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3335:x1820604024122304:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271996.470695:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024122368:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271996.470700:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736271996.470700:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00010000:02000000:3.0:1736271996.470703:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736271996.470709:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122496 00000100:00100000:0.0:1736271996.470714:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024122624:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271996.470716:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:2.0:1736271996.470719:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024122560:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271996.470719:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024122368:12345-0@lo:38:kworker/u8:2.0 Request processed in 24us (150us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271996.470722:0:23102:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122688 00000100:00100000:3.0:1736271996.470724:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:0.0:1736271996.470727:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736271996.470730:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:3.0:1736271996.470732:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024122496:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736271996.470735:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084664c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024122816:0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736271996.470736:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736271996.470737:0:23102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7156 00000100:00100000:1.0:1736271996.470740:0:23102:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024122688:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271996.470743:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736271996.470747:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3333:x1820604024122560:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271996.470750:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024122496:12345-0@lo:38:kworker/u8:2.0 Request processed in 17us (50us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736271996.470752:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1736271996.470754:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:1.0:1736271996.470759:0:23102:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024122688:12345-0@lo:400:kworker/u8:2.0 Request processed in 19us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1736271996.470759:0:27148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122816 00000100:00080000:0.0:1736271996.470762:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271996.470763:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271996.470763:0:23102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7156 00000100:00100000:0.0:1736271996.470765:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084667200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024122496:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736271996.470766:0:27148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:3.0:1736271996.470767:0:27148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024122816:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736271996.470769:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271996.470770:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00010000:02000000:3.0:1736271996.470770:0:27148:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736271996.470772:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084665f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024122368:0@lo:38:kworker/u8:2.0 00000100:00100000:1.0:1736271996.470775:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122624 00000100:00100000:2.0:1736271996.470782:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084664740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024122688:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271996.470785:0:27148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1820604024122816:12345-0@lo:38:kworker/u8:2.0 Request processed in 17us (41us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736271996.470787:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112855 00000100:00100000:3.0:1736271996.470787:0:27148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00080000:0.0:1736271996.470788:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271996.470789:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736271996.470790:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024122624:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736271996.470790:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084661300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3333:1820604024122560:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271996.470791:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084664c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024122816:0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736271996.470795:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736271996.470798:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084662ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024122752:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736271996.470809:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736271996.470822:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122752 00000100:00100000:1.0:1736271996.470824:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024122624:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (96us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736271996.470825:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da43bf2a-6599-41e6-baa1-4103623ce0d4:3335:1820604024122304:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271996.470829:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112855 00000100:00100000:0.0:1736271996.470840:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7157 00000100:00100000:0.0:1736271996.470843:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024122752:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736271996.470854:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024122432:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736271996.470877:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024122752:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1736271996.470881:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7157 00000100:00100000:3.0:1736271996.470899:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084662ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024122752:0@lo:400:kworker/u8:2.0 00000100:00080000:0.0:1736271996.470901:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736271996.470903:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736271996.470905:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024122624:0@lo:38:kworker/u8:2.0 00010000:00010000:2.0:1736271997.168517:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271998.170508:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736271999.172557:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736272000.166421:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736272000.166454:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b15580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024122944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736272000.166514:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736272000.166581:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122944 00000100:00100000:2.0:1736272000.166617:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5956 00000100:00100000:2.0:1736272000.166621:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024122944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736272000.166644:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736272000.166654:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc28e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024122880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736272000.166683:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736272000.166685:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024122944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1736272000.166690:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5956 00000100:00100000:1.0:1736272000.166713:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b15580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024122944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736272000.166720:0:9277:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024122880 00000100:00100000:2.0:1736272000.166733:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5957 00000100:00100000:2.0:1736272000.166736:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc2cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024122880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736272000.166748:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736272000.166782:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc2cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024122880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1736272000.166786:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5957 00000100:00100000:0.0:1736272000.166841:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc28e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024122880:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736272000.174572:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736272001.176506:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736272001.244473:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736272001.244517:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736272001.244559:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736272001.244595:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058984000 00000100:00100000:0.0:1736272001.244642:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983936 00000100:00100000:2.0:1736272001.244656:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058983872 00000100:00100000:0.0:1736272001.244657:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 924 00000100:00100000:0.0:1736272001.244661:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc28e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058984000:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736272001.244671:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1234 00000100:00100000:3.0:1736272001.244674:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc297c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058983936:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736272001.244685:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:2.0:1736272001.244697:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 362 00000100:00100000:2.0:1736272001.244702:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058983872:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736272001.244725:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc297c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1891:x1820604058983936:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 50us (165us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736272001.244730:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1234 00000100:00100000:2.0:1736272001.244751:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058983872:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 48us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1736272001.244757:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 362 00000100:00100000:0.0:1736272001.244792:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc28e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058984000:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 130us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1736272001.244798:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 924 00000100:00080000:2.0:1736272001.478458:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736272001.478464:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736272001.478466:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736272001.478471:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8781 00000100:00080000:2.0:1736272001.478475:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736272001.478480:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736272001.478497:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084664740 x1820604024123072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736272001.478499:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736272001.478515:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084661300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024123008:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736272001.478539:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736272001.478541:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736272001.478542:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736272001.478545:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8781 00000100:00080000:2.0:1736272001.478546:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736272001.478549:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736272001.478556:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084662140 x1820604024123200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736272001.478566:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1736272001.478568:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736272001.478570:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1736272001.478572:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736272001.478575:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084660e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024123264:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736272001.478580:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736272001.478583:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8781 00000100:00080000:2.0:1736272001.478584:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736272001.478586:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736272001.478595:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800846650c0 x1820604024123328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736272001.478597:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084664740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024123072:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736272001.478601:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736272001.478616:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736272001.478616:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123008 00000100:00100000:0.0:1736272001.478617:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084665580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024123136:0@lo:400:kworker/u8:2.0 00000100:00080000:2.0:1736272001.478618:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736272001.478619:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736272001.478621:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8781 00000100:00080000:2.0:1736272001.478622:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736272001.478624:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1736272001.478630:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736272001.478631:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084660000 x1820604024123520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736272001.478643:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1736272001.478644:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123264 00000100:00100000:1.0:1736272001.478646:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084662140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024123200:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736272001.478646:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024123456:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736272001.478648:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024123008:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736272001.478664:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123072 00000100:00100000:0.0:1736272001.478674:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:0.0:1736272001.478676:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cef6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024123264:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736272001.478715:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736272001.478720:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024123008:12345-0@lo:400:kworker/u8:2.0 Request processed in 72us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1736272001.478722:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cef6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3336:x1820604024123264:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1736272001.478724:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736272001.478725:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1736272001.478727:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:1.0:1736272001.478729:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024123328:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736272001.478735:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123200 00000100:00100000:2.0:1736272001.478742:0:3334:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736272001.478746:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084662ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024123392:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736272001.478747:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736272001.478749:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1736272001.478752:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b15580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024123072:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736272001.478752:0:27147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:1.0:1736272001.478754:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024123520:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736272001.478755:0:27147:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024123200:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736272001.478760:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736272001.478761:0:27147:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736272001.478762:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736272001.478766:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736272001.478784:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b15580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024123072:12345-0@lo:38:kworker/u8:2.0 Request processed in 32us (155us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736272001.478785:0:27147:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1820604024123200:12345-0@lo:38:kworker/u8:2.0 Request processed in 30us (71us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736272001.478787:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123456 00000100:00100000:0.0:1736272001.478789:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:1.0:1736272001.478790:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123328 00000100:00100000:3.0:1736272001.478796:0:27147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:0.0:1736272001.478803:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123520 00000100:00100000:1.0:1736272001.478804:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112856 00000100:00100000:2.0:1736272001.478805:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123392 00000100:00100000:1.0:1736272001.478807:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b13900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024123328:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:1.0:1736272001.478813:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736272001.478814:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1736272001.478816:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024123520:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736272001.478817:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7158 00000100:00100000:2.0:1736272001.478820:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084664c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024123456:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736272001.478820:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084661300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024123008:0@lo:400:kworker/u8:2.0 00010000:02000000:0.0:1736272001.478821:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736272001.478828:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b13900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024123328:12345-0@lo:38:kworker/u8:2.0 Request processed in 21us (82us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736272001.478832:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112856 00000100:00100000:0.0:1736272001.478845:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024123520:12345-0@lo:38:kworker/u8:2.0 Request processed in 28us (79us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736272001.478848:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084664c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024123456:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1736272001.478849:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1736272001.478853:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7159 00000100:00100000:2.0:1736272001.478856:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7158 00000100:00100000:1.0:1736272001.478857:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084665f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024123392:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736272001.478864:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736272001.478874:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123136 00000100:00100000:1.0:1736272001.478882:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084665f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024123392:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1736272001.478884:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084660e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3336:1820604024123264:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736272001.478886:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7159 00000100:00100000:2.0:1736272001.478886:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024123456:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736272001.478898:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084662ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024123392:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736272001.478904:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736272001.478906:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736272001.478908:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024123328:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736272001.478913:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736272001.478915:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736272001.478916:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024123520:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736272001.478921:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736272001.478922:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736272001.478923:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084664740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024123072:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736272001.478928:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736272001.478930:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736272001.478931:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084662140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024123200:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736272001.479760:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:3.0:1736272001.479764:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb15580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024123136:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736272001.479797:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb15580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3336:x1820604024123136:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1736272001.479802:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:0.0:1736272001.479814:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084665580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3336:1820604024123136:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736272002.178451:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736272003.180690:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736272004.182462:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736272005.174483:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b14280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024123584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736272005.174546:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736272005.174589:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736272005.174594:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009cb104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024123648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736272005.174610:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736272005.174643:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123584 00000100:00100000:2.0:1736272005.174683:0:11119:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123648 00000100:00100000:2.0:1736272005.174696:0:11119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5958 00000100:00100000:2.0:1736272005.174699:0:11119:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880084662ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024123584:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736272005.174711:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5959 00000100:00100000:0.0:1736272005.174715:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846676c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024123648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736272005.174722:0:11119:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00002000:00000024:0.0:1736272005.174729:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:2.0:1736272005.174751:0:11119:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880084662ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024123584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1736272005.174755:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846676c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024123648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1736272005.174757:0:11119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5958 00000100:00100000:0.0:1736272005.174759:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5959 00000100:00100000:2.0:1736272005.174788:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009cb104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024123648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736272005.174896:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b14280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024123584:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1736272005.184592:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736272006.186664:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736272006.252623:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736272006.252660:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1736272006.252709:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058984192 00000100:00100000:0.0:1736272006.252713:0:3328:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736272006.252744:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058984064 00000100:00100000:2.0:1736272006.252753:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058984128 00000100:00100000:2.0:1736272006.252767:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 927 00000100:00100000:2.0:1736272006.252772:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb10e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058984192:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736272006.252772:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1238 00000100:00100000:0.0:1736272006.252774:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 364 00000100:00100000:0.0:1736272006.252777:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058984064:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736272006.252777:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058984128:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736272006.252788:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:0.0:1736272006.252820:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1894:x1820604058984064:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 42us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1736272006.252821:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb10e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058984192:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 48us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1736272006.252823:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1891:x1820604058984128:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 45us (164us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736272006.252825:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 364 00000100:00100000:3.0:1736272006.252829:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1238 00000100:00100000:2.0:1736272006.252843:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 927 00000100:00080000:2.0:1736272006.486469:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736272006.486473:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736272006.486476:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736272006.486481:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8786 00000100:00080000:2.0:1736272006.486484:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736272006.486488:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736272006.486505:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084665580 x1820604024123776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736272006.486533:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736272006.486535:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736272006.486536:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736272006.486538:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8786 00000100:00080000:2.0:1736272006.486542:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736272006.486545:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1736272006.486545:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084667200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024123712:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736272006.486552:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880084664740 x1820604024123904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736272006.486568:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736272006.486571:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736272006.486572:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736272006.486574:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8786 00000100:00080000:2.0:1736272006.486575:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736272006.486576:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736272006.486584:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800846650c0 x1820604024124032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736272006.486607:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736272006.486609:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736272006.486610:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736272006.486610:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736272006.486612:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8786 00000100:00080000:2.0:1736272006.486614:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736272006.486616:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736272006.486622:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008464c740 x1820604024124224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736272006.486637:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084661300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024124160:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736272006.486638:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084660e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024124096:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736272006.486657:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736272006.486716:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123712 00000100:00100000:0.0:1736272006.486741:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1736272006.486745:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024123712:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736272006.486800:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084665580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024123776:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736272006.486849:0:3333:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736272006.486854:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084662140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024123840:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736272006.486861:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3333:x1820604024123712:12345-0@lo:400:kworker/u8:2.0 Request processed in 115us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1736272006.486867:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1736272006.486878:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736272006.486918:0:27667:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123840 00000100:00100000:3.0:1736272006.486924:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084667200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da43bf2a-6599-41e6-baa1-4103623ce0d4:3333:1820604024123712:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736272006.486945:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024123968:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736272006.486956:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1736272006.486960:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024123840:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736272006.486985:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736272006.487009:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124160 00000100:00100000:3.0:1736272006.487010:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123776 00000100:00100000:3.0:1736272006.487028:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1736272006.487031:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb13dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024123776:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736272006.487046:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736272006.487089:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084664740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024123904:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736272006.487099:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb13dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024123776:12345-0@lo:38:kworker/u8:2.0 Request processed in 68us (115us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736272006.487103:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1736272006.487107:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024123840:12345-0@lo:400:kworker/u8:2.0 Request processed in 146us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1736272006.487111:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736272006.487113:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:3.0:1736272006.487116:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123904 00000100:00100000:0.0:1736272006.487119:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800846650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024124032:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736272006.487125:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1736272006.487127:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb12f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024123904:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:3.0:1736272006.487130:0:27660:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736272006.487140:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb12f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3332:x1820604024123904:12345-0@lo:38:kworker/u8:2.0 Request processed in 13us (30us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736272006.487143:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7160 00000100:00100000:3.0:1736272006.487143:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:2.0:1736272006.487148:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024124160:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736272006.487159:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084662140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024123840:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736272006.487291:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736272006.487308:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024124224:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736272006.487323:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736272006.487351:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736272006.487353:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736272006.487355:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084665580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024123776:0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736272006.487362:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736272006.487364:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736272006.487365:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084664740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024123904:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736272006.487402:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736272006.487475:0:27356:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124032 00000100:00100000:1.0:1736272006.487500:0:27356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112857 00000100:00100000:1.0:1736272006.487504:0:27356:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb13900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024124032:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736272006.487509:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3333:x1820604024124160:12345-0@lo:400:kworker/u8:2.0 Request processed in 361us (852us total) trans 0 rc 0/0 00010000:02000000:1.0:1736272006.487510:0:27356:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736272006.487513:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7160 00000100:00100000:2.0:1736272006.487527:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736272006.487528:0:27356:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb13900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024124032:12345-0@lo:38:kworker/u8:2.0 Request processed in 25us (269us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736272006.487532:0:27356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112857 00000100:00100000:2.0:1736272006.487543:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124096 00000100:00100000:2.0:1736272006.487554:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7161 00000100:00100000:2.0:1736272006.487557:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024124096:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736272006.487578:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024124096:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (50us total) trans 0 rc 0/0 00000100:00100000:2.0:1736272006.487582:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7161 00000100:00100000:3.0:1736272006.487596:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124224 00000100:00100000:2.0:1736272006.487597:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084660e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024124096:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736272006.487618:0:27149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024123968 00000100:00100000:3.0:1736272006.487636:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:3.0:1736272006.487638:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb104c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024123968:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736272006.487665:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb104c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3335:x1820604024123968:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1736272006.487669:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:3.0:1736272006.487677:0:27149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:3.0:1736272006.487679:0:27149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cb11300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024124224:12345-0@lo:38:kworker/u8:2.0 00000100:00080000:0.0:1736272006.487682:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736272006.487684:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00010000:02000000:3.0:1736272006.487684:0:27149:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736272006.487686:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800846650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024124032:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736272006.487696:0:27149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cb11300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1820604024124224:12345-0@lo:38:kworker/u8:2.0 Request processed in 16us (373us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736272006.487697:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736272006.487700:0:27149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00080000:0.0:1736272006.487703:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:0.0:1736272006.487705:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024124224:0@lo:38:kworker/u8:2.0 00000100:00100000:3.0:1736272006.487716:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084661300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3333:1820604024124160:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736272006.487720:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3335:1820604024123968:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1736272007.188577:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736272008.190508:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736272009.192497:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736272010.182457:0:3336:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736272010.182473:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131b11c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024124352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736272010.182482:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084648e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024124288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736272010.182528:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736272010.182559:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124352 00000100:00100000:1.0:1736272010.182568:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736272010.182586:0:1876:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124288 00000100:00100000:2.0:1736272010.182595:0:9278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5960 00000100:00100000:2.0:1736272010.182600:0:9278:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008464af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024124352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736272010.182622:0:9278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736272010.182637:0:9277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5961 00000100:00100000:1.0:1736272010.182641:0:9277:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b12ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024124288:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736272010.182648:0:9278:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008464af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3336:x1820604024124352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1736272010.182653:0:9278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5960 00002000:00000024:1.0:1736272010.182654:0:9277:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140096 pending 0 free 3923451904 avail 3691929600 00000100:00100000:1.0:1736272010.182680:0:9277:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b12ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3334:x1820604024124288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1736272010.182685:0:9277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5961 00000100:00100000:2.0:1736272010.182685:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131b11c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3336:1820604024124352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736272010.182708:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084648e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3334:1820604024124288:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736272010.194605:0:9291:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736272011.196474:0:6841:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736272011.260446:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736272011.260488:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1736272011.260522:0:18267:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058984256 00000100:00100000:0.0:1736272011.260525:0:3327:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1736272011.260553:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058984384 00000100:00100000:3.0:1736272011.260555:0:18267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 366 00000100:00100000:3.0:1736272011.260559:0:18267:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058984256:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1736272011.260586:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604058984320 00000100:00100000:0.0:1736272011.260597:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 930 00000100:00100000:0.0:1736272011.260600:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058984384:12345-192.168.203.38@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736272011.260608:0:18267:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63aec7dc-4f2e-4a07-ad0b-fad1193865d8+9:1895:x1820604058984256:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 49us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1736272011.260610:0:27667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1242 00000100:00100000:3.0:1736272011.260614:0:18267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 366 00000100:00100000:1.0:1736272011.260615:0:27667:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058984320:12345-192.168.203.38@tcp:38:kworker/u8:2.0 00000100:00100000:0.0:1736272011.260619:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64bb3b11-afd7-4230-a38c-2a374f07ba02+6:1894:x1820604058984384:12345-192.168.203.38@tcp:400:kworker/u8:2.0 Request processed in 18us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1736272011.260624:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 930 00010000:02000000:1.0:1736272011.260627:0:27667:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.38@tcp (stopping) 00000100:00100000:1.0:1736272011.260651:0:27667:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1891:x1820604058984320:12345-192.168.203.38@tcp:38:kworker/u8:2.0 Request processed in 37us (126us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736272011.260663:0:27667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1242 00000100:00080000:2.0:1736272011.494422:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736272011.494429:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736272011.494431:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736272011.494436:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8791 00000100:00080000:2.0:1736272011.494439:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736272011.494443:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88008d8b4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736272011.494459:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008464e3c0 x1820604024124480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736272011.494461:0:3336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024124416:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736272011.494480:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024124480:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736272011.494497:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736272011.494500:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736272011.494501:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736272011.494503:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8791 00000100:00080000:2.0:1736272011.494505:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736272011.494508:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8800937c3800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1736272011.494526:0:3336:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736272011.494527:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736272011.494555:0:3333:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024124544:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736272011.494568:0:18269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124416 00000100:00100000:3.0:1736272011.494578:0:3333:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736272011.494596:0:18269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1736272011.494600:0:18269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880089926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024124416:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1736272011.494616:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124480 00000100:00100000:3.0:1736272011.494630:0:27660:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124544 00000100:00100000:0.0:1736272011.494632:0:18269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880089926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da43bf2a-6599-41e6-baa1-4103623ce0d4+18:3336:x1820604024124416:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1736272011.494637:0:18269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1736272011.494656:0:27660:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:3.0:1736272011.494659:0:27660:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800899d1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024124544:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736272011.494670:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:0.0:1736272011.494673:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b16d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024124480:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736272011.494682:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736272011.494689:0:27660:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800899d1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3333:x1820604024124544:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1736272011.494693:0:27660:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:0.0:1736272011.494706:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b16d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024124480:12345-0@lo:38:kworker/u8:2.0 Request processed in 32us (180us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736272011.494710:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:3.0:1736272011.494720:0:3333:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3333:1820604024124544:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736272011.494731:0:3336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da43bf2a-6599-41e6-baa1-4103623ce0d4:3336:1820604024124416:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736272011.494742:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008d8b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736272011.494744:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736272011.494747:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1820604024124480:0@lo:38:kworker/u8:2.0 00000100:00100000:2.0:1736272011.494780:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008464d580 x1820604024124608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736272011.494809:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736272011.494811:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736272011.494812:0:19360:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736272011.494814:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8791 00000100:00080000:2.0:1736272011.494815:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1736272011.494817:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024124608:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736272011.494818:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8801368e5000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736272011.494825:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008464a140 x1820604024124736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736272011.494830:0:3334:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024124672:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736272011.494835:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736272011.494844:0:19360:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736272011.494846:0:19360:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736272011.494847:0:19360:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736272011.494848:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024124736:0@lo:38:kworker/u8:2.0 00000100:00080000:2.0:1736272011.494849:0:19360:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8791 00000100:00080000:2.0:1736272011.494850:0:19360:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1736272011.494851:0:3334:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736272011.494852:0:19360:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff88008faa2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1736272011.494858:0:19360:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008464c740 x1820604024124928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736272011.494864:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736272011.494872:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124608 00000100:00100000:1.0:1736272011.494876:0:3332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024124928:0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736272011.494881:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124672 00000100:00100000:2.0:1736272011.494883:0:27358:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124736 00000100:00100000:1.0:1736272011.494887:0:3332:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736272011.494900:0:3854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124928 00000100:00100000:1.0:1736272011.494901:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008464b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024124800:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736272011.494906:0:27358:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112858 00000100:00100000:2.0:1736272011.494910:0:27358:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b10e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024124736:12345-0@lo:38:kworker/u8:2.0 00000100:00100000:0.0:1736272011.494914:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00010000:02000000:2.0:1736272011.494916:0:27358:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736272011.494917:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c13d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024124672:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736272011.494918:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736272011.494929:0:3335:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736272011.494932:0:3335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880084648e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024124864:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736272011.494944:0:27358:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b10e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3332:x1820604024124736:12345-0@lo:38:kworker/u8:2.0 Request processed in 34us (79us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736272011.494945:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c13d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3334:x1820604024124672:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1736272011.494947:0:3335:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736272011.494949:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:2.0:1736272011.494949:0:27358:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112858 00000100:00100000:0.0:1736272011.494955:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1736272011.494957:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024124608:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736272011.494960:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736272011.494963:0:23101:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124800 00000100:00100000:2.0:1736272011.494967:0:23104:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820604024124864 00000100:00100000:0.0:1736272011.494970:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024124608:12345-0@lo:38:kworker/u8:2.0 Request processed in 13us (136us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736272011.494972:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1736272011.494976:0:3854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1736272011.494977:0:3854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b12600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024124928:12345-0@lo:38:kworker/u8:2.0 00010000:02000000:0.0:1736272011.494980:0:3854:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736272011.494982:0:23101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7162 00000100:00100000:1.0:1736272011.494985:0:23101:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b13440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024124800:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1736272011.494988:0:23104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7163 00000100:00100000:2.0:1736272011.494991:0:23104:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b12f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024124864:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1736272011.494993:0:3854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b12600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3332:x1820604024124928:12345-0@lo:38:kworker/u8:2.0 Request processed in 15us (105us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736272011.494995:0:3854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1736272011.495011:0:3334:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3334:1820604024124672:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736272011.495011:0:23101:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b13440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024124800:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1736272011.495015:0:23101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7162 00000100:00100000:2.0:1736272011.495019:0:23104:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b12f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3335:x1820604024124864:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1736272011.495023:0:23104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7163 00000100:00100000:1.0:1736272011.495041:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880084648e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024124864:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1736272011.495047:0:3335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3335:1820604024124800:0@lo:400:kworker/u8:2.0 00000100:00080000:1.0:1736272011.495061:0:3332:0:(import.c:86:import_set_state_nolock()) ffff88008faa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736272011.495062:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736272011.495064:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3332:1820604024124928:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736272011.495069:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8801368e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736272011.495070:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736272011.495072:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3332:1820604024124736:0@lo:38:kworker/u8:2.0 00000100:00080000:1.0:1736272011.495076:0:3332:0:(import.c:86:import_set_state_nolock()) ffff8800937c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736272011.495078:0:3332:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.138@tcp failed (-19) 00000100:00100000:1.0:1736272011.495079:0:3332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008464d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1820604024124608:0@lo:38:kworker/u8:2.0 00000020:02000400:0.0:1736272011.575505:0:19949:0:(genops.c:1786:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 256 seconds. The obd refcount = 4. Is it stuck? 00000020:02000400:0.0:1736272011.580657:0:19949:0:(genops.c:1752:print_export_data()) lustre-MDT0000: UNLINKED ffff88008faa8000 64bb3b11-afd7-4230-a38c-2a374f07ba02 192.168.203.38@tcp 1 (0 0 0) 1 0 1 0: (null) 523986010115 stale:0 00010000:00010000:2.0:1736272012.198571:0:24474:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736272013.200505:0:6840:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736272014.202535:0:9292:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 18994 lines, 18994 kept, 0 dropped, 0 bad.