00000100:00100000:1.0F:1736366108.493679:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+2:1873:x1820703041009920:12345-192.168.201.2@tcp:38:ptlrpcd_rcv.0 Request processed in 25911us (25976us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366108.493690:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 634 00000100:00100000:0.0F:1736366108.494608:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366108.494634:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366108.494643:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041010048 00000100:00100000:0.0:1736366108.494654:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0F:1736366108.494660:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041009984 00000100:00100000:1.0:1736366108.494661:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 635 00000100:00100000:1.0:1736366108.494664:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1876:x1820703041010048:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000020:02000000:1.0:1736366108.494667:0:25142:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0F:1736366108.494672:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041010112 00000100:00100000:2.0:1736366108.494684:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 157 00000100:00100000:2.0:1736366108.494687:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1877:x1820703041009984:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366108.494690:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1876:x1820703041010048:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 26us (84us total) trans 0 rc 0/0 00000020:02000000:2.0:1736366108.494690:0:16269:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1736366108.494693:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 635 00000100:00100000:3.0:1736366108.494695:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 7179 00000100:00100000:3.0:1736366108.494698:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1877:x1820703041010112:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000020:02000000:3.0:1736366108.494701:0:9254:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1736366108.494708:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1877:x1820703041009984:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 21us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366108.494712:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 157 00000100:00100000:3.0:1736366108.494721:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1877:x1820703041010112:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 22us (67us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366108.494724:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 7179 00000400:00080000:2.0:1736366108.504975:0:16921:0:(debug.c:393:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1736366108.16295 00010000:02000000:0.0:1736366108.505033:0:16295:0:(ldlm_lib.c:1759:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:02, of 2 clients 1 recovered and 1 was evicted. 00000004:00080000:2.0:1736366108.520938:0:16282:0:(osp_precreate.c:874:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x45ea:0x0] 00000004:00080000:3.0:1736366108.520956:0:16284:0:(osp_precreate.c:874:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x4190:0x0] 00000100:00100000:2.0:1736366108.520976:0:16282:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800869c63c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16282:1820703013013056:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1736366108.520976:0:16284:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095174740 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16284:1820703013013120:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1736366108.521022:0:16284:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366108.521045:0:16284:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012a343cc0 going to sleep for 20 seconds 00000100:00100000:2.0:1736366108.521047:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013120 00000100:00100000:2.0:1736366108.521085:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94686 00000100:00100000:2.0:1736366108.521091:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086935a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:16284:x1820703013013120:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:2.0:1736366108.521096:0:9254:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:2.0:1736366108.521116:0:9254:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 17313 -> diff = -529 00002000:02000040:2.0:1736366108.521119:0:9254:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0001: deleting orphan objects from 0x0:16785 to 0x0:17313 00002000:00010000:2.0:1736366108.523183:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x43a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.523188:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef19b00/0x98871c73fd0e76df lrc: 3/0,1 mode: --/PW res: [0x43a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523197:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523198:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523201:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef19b00/0x98871c73fd0e76df lrc: 3/0,1 mode: PW/PW res: [0x43a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523209:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006ef19b00/0x98871c73fd0e76df lrc: 3/0,1 mode: PW/PW res: [0x43a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523222:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef19b00/0x98871c73fd0e76df lrc: 3/0,1 mode: PW/PW res: [0x43a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523225:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef19b00/0x98871c73fd0e76df lrc: 2/0,0 mode: PW/PW res: [0x43a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523233:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1736366108.523236:0:16282:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366108.523257:0:16282:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5792d80 going to sleep for 20 seconds 00010000:00010000:3.0:1736366108.523266:0:10475:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1736366108.523269:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013056 00010000:00010000:3.0:1736366108.523269:0:10475:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006ef19b00/0x98871c73fd0e76df lrc: 2/0,0 mode: PW/PW res: [0x43a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.523276:0:10475:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006ef19b00 already unused, calling callback (ffffffffa0811190) 00010000:00010000:3.0:1736366108.523277:0:10475:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef19b00/0x98871c73fd0e76df lrc: 2/0,0 mode: PW/PW res: [0x43a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.523282:0:10475:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef19b00/0x98871c73fd0e76df lrc: 3/0,0 mode: PW/PW res: [0x43a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1736366108.523286:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94687 00000100:00100000:0.0:1736366108.523289:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:16282:x1820703013013056:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:0.0:1736366108.523292:0:29930:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:3.0:1736366108.523293:0:10475:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006ef19b00/0x98871c73fd0e76df lrc: 1/0,0 mode: --/PW res: [0x43a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.523296:0:10475:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006ef19b00/0x98871c73fd0e76df lrc: 0/0,0 mode: --/PW res: [0x43a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1736366108.523300:0:29930:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 17929 -> diff = -31 00002000:02000040:0.0:1736366108.523302:0:29930:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0000: deleting orphan objects from 0x0:17899 to 0x0:17929 00010000:00010000:3.0:1736366108.523311:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366108.523312:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366108.523313:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.523335:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x43a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.523337:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef1a1c0/0x98871c73fd0e76e6 lrc: 3/0,1 mode: --/PW res: [0x43a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523341:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523342:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523343:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef1a1c0/0x98871c73fd0e76e6 lrc: 3/0,1 mode: PW/PW res: [0x43a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523347:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006ef1a1c0/0x98871c73fd0e76e6 lrc: 3/0,1 mode: PW/PW res: [0x43a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523350:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef1a1c0/0x98871c73fd0e76e6 lrc: 3/0,1 mode: PW/PW res: [0x43a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523353:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef1a1c0/0x98871c73fd0e76e6 lrc: 2/0,0 mode: PW/PW res: [0x43a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523359:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.523363:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.523366:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006ef1a1c0/0x98871c73fd0e76e6 lrc: 2/0,0 mode: PW/PW res: [0x43a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523372:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006ef1a1c0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.523373:0:6822:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef1a1c0/0x98871c73fd0e76e6 lrc: 2/0,0 mode: PW/PW res: [0x43a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523378:0:6822:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef1a1c0/0x98871c73fd0e76e6 lrc: 3/0,0 mode: PW/PW res: [0x43a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523385:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006ef1a1c0/0x98871c73fd0e76e6 lrc: 1/0,0 mode: --/PW res: [0x43a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523388:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006ef1a1c0/0x98871c73fd0e76e6 lrc: 0/0,0 mode: --/PW res: [0x43a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1736366108.523389:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x439f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.523395:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef19200/0x98871c73fd0e76ed lrc: 3/0,1 mode: --/PW res: [0x439f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523397:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.523399:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523400:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523400:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef19200/0x98871c73fd0e76ed lrc: 3/0,1 mode: PW/PW res: [0x439f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523402:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.523403:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.523405:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006ef19200/0x98871c73fd0e76ed lrc: 3/0,1 mode: PW/PW res: [0x439f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523408:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef19200/0x98871c73fd0e76ed lrc: 3/0,1 mode: PW/PW res: [0x439f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523411:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef19200/0x98871c73fd0e76ed lrc: 2/0,0 mode: PW/PW res: [0x439f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523417:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1736366108.523459:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x439e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.523461:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b840/0x98871c73fd0e76f4 lrc: 3/0,1 mode: --/PW res: [0x439e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523465:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523465:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523466:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b840/0x98871c73fd0e76f4 lrc: 3/0,1 mode: PW/PW res: [0x439e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523470:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b840/0x98871c73fd0e76f4 lrc: 3/0,1 mode: PW/PW res: [0x439e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523479:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b840/0x98871c73fd0e76f4 lrc: 3/0,1 mode: PW/PW res: [0x439e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523482:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b840/0x98871c73fd0e76f4 lrc: 2/0,0 mode: PW/PW res: [0x439e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523487:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1736366108.523518:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x439d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.523520:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef19680/0x98871c73fd0e76fb lrc: 3/0,1 mode: --/PW res: [0x439d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523523:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523523:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523524:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef19680/0x98871c73fd0e76fb lrc: 3/0,1 mode: PW/PW res: [0x439d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523528:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006ef19680/0x98871c73fd0e76fb lrc: 3/0,1 mode: PW/PW res: [0x439d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523531:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef19680/0x98871c73fd0e76fb lrc: 3/0,1 mode: PW/PW res: [0x439d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523534:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef19680/0x98871c73fd0e76fb lrc: 2/0,0 mode: PW/PW res: [0x439d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523539:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1736366108.523559:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1736366108.523562:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006ef19200/0x98871c73fd0e76ed lrc: 2/0,0 mode: PW/PW res: [0x439f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1736366108.523564:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x439c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.523566:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006ef19200 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.523567:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef19200/0x98871c73fd0e76ed lrc: 2/0,0 mode: PW/PW res: [0x439f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523569:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b600/0x98871c73fd0e7702 lrc: 3/0,1 mode: --/PW res: [0x439c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523571:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef19200/0x98871c73fd0e76ed lrc: 3/0,0 mode: PW/PW res: [0x439f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523573:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523573:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523574:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b600/0x98871c73fd0e7702 lrc: 3/0,1 mode: PW/PW res: [0x439c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523578:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006ef19200/0x98871c73fd0e76ed lrc: 1/0,0 mode: --/PW res: [0x439f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523578:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b600/0x98871c73fd0e7702 lrc: 3/0,1 mode: PW/PW res: [0x439c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523581:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006ef19200/0x98871c73fd0e76ed lrc: 0/0,0 mode: --/PW res: [0x439f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523581:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b600/0x98871c73fd0e7702 lrc: 3/0,1 mode: PW/PW res: [0x439c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523583:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b600/0x98871c73fd0e7702 lrc: 2/0,0 mode: PW/PW res: [0x439c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523588:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1736366108.523589:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b840/0x98871c73fd0e76f4 lrc: 2/0,0 mode: PW/PW res: [0x439e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523589:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1736366108.523592:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006ef1b840 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.523593:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b840/0x98871c73fd0e76f4 lrc: 2/0,0 mode: PW/PW res: [0x439e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523596:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b840/0x98871c73fd0e76f4 lrc: 3/0,0 mode: PW/PW res: [0x439e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523608:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b840/0x98871c73fd0e76f4 lrc: 1/0,0 mode: --/PW res: [0x439e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523611:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b840/0x98871c73fd0e76f4 lrc: 0/0,0 mode: --/PW res: [0x439e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523617:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1736366108.523617:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006ef19680/0x98871c73fd0e76fb lrc: 2/0,0 mode: PW/PW res: [0x439d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1736366108.523618:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x439b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.523620:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006ef19680 already unused, calling callback (ffffffffa0811190) 00010000:00010000:2.0:1736366108.523620:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef186c0/0x98871c73fd0e7709 lrc: 3/0,1 mode: --/PW res: [0x439b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523621:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef19680/0x98871c73fd0e76fb lrc: 2/0,0 mode: PW/PW res: [0x439d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523624:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523628:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736366108.523629:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef19680/0x98871c73fd0e76fb lrc: 3/0,0 mode: PW/PW res: [0x439d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523629:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef186c0/0x98871c73fd0e7709 lrc: 3/0,1 mode: PW/PW res: [0x439b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523634:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006ef19680/0x98871c73fd0e76fb lrc: 1/0,0 mode: --/PW res: [0x439d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523637:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006ef19680/0x98871c73fd0e76fb lrc: 0/0,0 mode: --/PW res: [0x439d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523642:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736366108.523642:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006ef186c0/0x98871c73fd0e7709 lrc: 3/0,1 mode: PW/PW res: [0x439b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523643:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b600/0x98871c73fd0e7702 lrc: 2/0,0 mode: PW/PW res: [0x439c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523651:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006ef1b600 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.523652:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b600/0x98871c73fd0e7702 lrc: 2/0,0 mode: PW/PW res: [0x439c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523652:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef186c0/0x98871c73fd0e7709 lrc: 3/0,1 mode: PW/PW res: [0x439b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523655:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b600/0x98871c73fd0e7702 lrc: 3/0,0 mode: PW/PW res: [0x439c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523655:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef186c0/0x98871c73fd0e7709 lrc: 2/0,0 mode: PW/PW res: [0x439b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523659:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b600/0x98871c73fd0e7702 lrc: 1/0,0 mode: --/PW res: [0x439c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523661:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.523662:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006ef1b600/0x98871c73fd0e7702 lrc: 0/0,0 mode: --/PW res: [0x439c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523667:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.523668:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006ef186c0/0x98871c73fd0e7709 lrc: 2/0,0 mode: PW/PW res: [0x439b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523671:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006ef186c0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.523672:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef186c0/0x98871c73fd0e7709 lrc: 2/0,0 mode: PW/PW res: [0x439b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523674:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef186c0/0x98871c73fd0e7709 lrc: 3/0,0 mode: PW/PW res: [0x439b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523678:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006ef186c0/0x98871c73fd0e7709 lrc: 1/0,0 mode: --/PW res: [0x439b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523686:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006ef186c0/0x98871c73fd0e7709 lrc: 0/0,0 mode: --/PW res: [0x439b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523692:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.523693:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.523694:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.523694:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x439a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.523696:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.523696:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef18b40/0x98871c73fd0e7710 lrc: 3/0,1 mode: --/PW res: [0x439a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523698:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.523699:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523700:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523701:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef18b40/0x98871c73fd0e7710 lrc: 3/0,1 mode: PW/PW res: [0x439a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523704:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.523705:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006ef18b40/0x98871c73fd0e7710 lrc: 3/0,1 mode: PW/PW res: [0x439a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523708:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006ef18b40/0x98871c73fd0e7710 lrc: 3/0,1 mode: PW/PW res: [0x439a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523711:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006ef18b40/0x98871c73fd0e7710 lrc: 2/0,0 mode: PW/PW res: [0x439a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523716:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.523719:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.523720:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006ef18b40/0x98871c73fd0e7710 lrc: 2/0,0 mode: PW/PW res: [0x439a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523723:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006ef18b40 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.523724:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef18b40/0x98871c73fd0e7710 lrc: 2/0,0 mode: PW/PW res: [0x439a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523727:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006ef18b40/0x98871c73fd0e7710 lrc: 3/0,0 mode: PW/PW res: [0x439a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523732:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006ef18b40/0x98871c73fd0e7710 lrc: 1/0,0 mode: --/PW res: [0x439a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523735:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006ef18b40/0x98871c73fd0e7710 lrc: 0/0,0 mode: --/PW res: [0x439a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523740:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.523744:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.523744:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4399:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.523745:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.523749:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdef40/0x98871c73fd0e7717 lrc: 3/0,1 mode: --/PW res: [0x4399:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523753:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523754:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523755:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdef40/0x98871c73fd0e7717 lrc: 3/0,1 mode: PW/PW res: [0x4399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523759:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdef40/0x98871c73fd0e7717 lrc: 3/0,1 mode: PW/PW res: [0x4399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523762:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdef40/0x98871c73fd0e7717 lrc: 3/0,1 mode: PW/PW res: [0x4399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523765:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdef40/0x98871c73fd0e7717 lrc: 2/0,0 mode: PW/PW res: [0x4399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523770:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.523772:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.523787:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdef40/0x98871c73fd0e7717 lrc: 2/0,0 mode: PW/PW res: [0x4399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523791:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdef40 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.523792:0:6822:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdef40/0x98871c73fd0e7717 lrc: 2/0,0 mode: PW/PW res: [0x4399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523795:0:6822:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdef40/0x98871c73fd0e7717 lrc: 3/0,0 mode: PW/PW res: [0x4399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523800:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdef40/0x98871c73fd0e7717 lrc: 1/0,0 mode: --/PW res: [0x4399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523803:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdef40/0x98871c73fd0e7717 lrc: 0/0,0 mode: --/PW res: [0x4399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523810:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.523810:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.523811:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.523821:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4398:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.523824:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcb40/0x98871c73fd0e771e lrc: 3/0,1 mode: --/PW res: [0x4398:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523828:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523828:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523829:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcb40/0x98871c73fd0e771e lrc: 3/0,1 mode: PW/PW res: [0x4398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523833:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcb40/0x98871c73fd0e771e lrc: 3/0,1 mode: PW/PW res: [0x4398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523843:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcb40/0x98871c73fd0e771e lrc: 3/0,1 mode: PW/PW res: [0x4398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523846:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcb40/0x98871c73fd0e771e lrc: 2/0,0 mode: PW/PW res: [0x4398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523851:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.523853:0:14340:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.523855:0:14340:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcb40/0x98871c73fd0e771e lrc: 2/0,0 mode: PW/PW res: [0x4398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523858:0:14340:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdcb40 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.523859:0:14340:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcb40/0x98871c73fd0e771e lrc: 2/0,0 mode: PW/PW res: [0x4398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523869:0:14340:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcb40/0x98871c73fd0e771e lrc: 3/0,0 mode: PW/PW res: [0x4398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523874:0:14340:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcb40/0x98871c73fd0e771e lrc: 1/0,0 mode: --/PW res: [0x4398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523876:0:14340:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcb40/0x98871c73fd0e771e lrc: 0/0,0 mode: --/PW res: [0x4398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523882:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.523883:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.523883:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4397:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.523884:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.523885:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfa80/0x98871c73fd0e7725 lrc: 3/0,1 mode: --/PW res: [0x4397:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523888:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523889:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523889:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfa80/0x98871c73fd0e7725 lrc: 3/0,1 mode: PW/PW res: [0x4397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523893:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfa80/0x98871c73fd0e7725 lrc: 3/0,1 mode: PW/PW res: [0x4397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523896:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfa80/0x98871c73fd0e7725 lrc: 3/0,1 mode: PW/PW res: [0x4397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523899:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfa80/0x98871c73fd0e7725 lrc: 2/0,0 mode: PW/PW res: [0x4397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523904:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.523906:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.523907:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfa80/0x98871c73fd0e7725 lrc: 2/0,0 mode: PW/PW res: [0x4397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523910:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdfa80 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.523911:0:8052:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfa80/0x98871c73fd0e7725 lrc: 2/0,0 mode: PW/PW res: [0x4397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523914:0:8052:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfa80/0x98871c73fd0e7725 lrc: 3/0,0 mode: PW/PW res: [0x4397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523918:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfa80/0x98871c73fd0e7725 lrc: 1/0,0 mode: --/PW res: [0x4397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523921:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfa80/0x98871c73fd0e7725 lrc: 0/0,0 mode: --/PW res: [0x4397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1736366108.523928:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4396:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.523930:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.523931:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.523932:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.523933:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc000/0x98871c73fd0e772c lrc: 3/0,1 mode: --/PW res: [0x4396:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523937:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523938:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523939:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc000/0x98871c73fd0e772c lrc: 3/0,1 mode: PW/PW res: [0x4396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523942:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc000/0x98871c73fd0e772c lrc: 3/0,1 mode: PW/PW res: [0x4396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523945:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc000/0x98871c73fd0e772c lrc: 3/0,1 mode: PW/PW res: [0x4396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523948:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc000/0x98871c73fd0e772c lrc: 2/0,0 mode: PW/PW res: [0x4396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523953:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.523955:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.523956:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc000/0x98871c73fd0e772c lrc: 2/0,0 mode: PW/PW res: [0x4396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523959:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdc000 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.523960:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc000/0x98871c73fd0e772c lrc: 2/0,0 mode: PW/PW res: [0x4396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523963:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc000/0x98871c73fd0e772c lrc: 3/0,0 mode: PW/PW res: [0x4396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523967:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc000/0x98871c73fd0e772c lrc: 1/0,0 mode: --/PW res: [0x4396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523970:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc000/0x98871c73fd0e772c lrc: 0/0,0 mode: --/PW res: [0x4396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.523975:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.523975:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.523976:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.523983:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4395:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.523985:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbded00/0x98871c73fd0e7733 lrc: 3/0,1 mode: --/PW res: [0x4395:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523988:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523989:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.523990:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbded00/0x98871c73fd0e7733 lrc: 3/0,1 mode: PW/PW res: [0x4395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.523993:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbded00/0x98871c73fd0e7733 lrc: 3/0,1 mode: PW/PW res: [0x4395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524002:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbded00/0x98871c73fd0e7733 lrc: 3/0,1 mode: PW/PW res: [0x4395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524005:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbded00/0x98871c73fd0e7733 lrc: 2/0,0 mode: PW/PW res: [0x4395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524010:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524013:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524014:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbded00/0x98871c73fd0e7733 lrc: 2/0,0 mode: PW/PW res: [0x4395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524017:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbded00 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524020:0:6822:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbded00/0x98871c73fd0e7733 lrc: 2/0,0 mode: PW/PW res: [0x4395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524024:0:6822:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbded00/0x98871c73fd0e7733 lrc: 3/0,0 mode: PW/PW res: [0x4395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524029:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbded00/0x98871c73fd0e7733 lrc: 1/0,0 mode: --/PW res: [0x4395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524031:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbded00/0x98871c73fd0e7733 lrc: 0/0,0 mode: --/PW res: [0x4395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524037:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524038:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524038:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.524040:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4394:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.524042:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd680/0x98871c73fd0e773a lrc: 3/0,1 mode: --/PW res: [0x4394:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524045:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524046:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524047:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd680/0x98871c73fd0e773a lrc: 3/0,1 mode: PW/PW res: [0x4394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524050:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd680/0x98871c73fd0e773a lrc: 3/0,1 mode: PW/PW res: [0x4394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524053:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd680/0x98871c73fd0e773a lrc: 3/0,1 mode: PW/PW res: [0x4394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524056:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd680/0x98871c73fd0e773a lrc: 2/0,0 mode: PW/PW res: [0x4394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524060:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524062:0:14340:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524063:0:14340:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd680/0x98871c73fd0e773a lrc: 2/0,0 mode: PW/PW res: [0x4394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524066:0:14340:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdd680 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524066:0:14340:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd680/0x98871c73fd0e773a lrc: 2/0,0 mode: PW/PW res: [0x4394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524069:0:14340:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd680/0x98871c73fd0e773a lrc: 3/0,0 mode: PW/PW res: [0x4394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524074:0:14340:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd680/0x98871c73fd0e773a lrc: 1/0,0 mode: --/PW res: [0x4394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524082:0:14340:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd680/0x98871c73fd0e773a lrc: 0/0,0 mode: --/PW res: [0x4394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1736366108.524086:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4393:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.524088:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524088:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524089:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.524090:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbddf80/0x98871c73fd0e7741 lrc: 3/0,1 mode: --/PW res: [0x4393:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524094:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524095:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524096:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbddf80/0x98871c73fd0e7741 lrc: 3/0,1 mode: PW/PW res: [0x4393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524100:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbddf80/0x98871c73fd0e7741 lrc: 3/0,1 mode: PW/PW res: [0x4393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524103:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbddf80/0x98871c73fd0e7741 lrc: 3/0,1 mode: PW/PW res: [0x4393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524106:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbddf80/0x98871c73fd0e7741 lrc: 2/0,0 mode: PW/PW res: [0x4393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524111:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524112:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524113:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbddf80/0x98871c73fd0e7741 lrc: 2/0,0 mode: PW/PW res: [0x4393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524116:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbddf80 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524117:0:8052:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbddf80/0x98871c73fd0e7741 lrc: 2/0,0 mode: PW/PW res: [0x4393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524120:0:8052:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbddf80/0x98871c73fd0e7741 lrc: 3/0,0 mode: PW/PW res: [0x4393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524124:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbddf80/0x98871c73fd0e7741 lrc: 1/0,0 mode: --/PW res: [0x4393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524127:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbddf80/0x98871c73fd0e7741 lrc: 0/0,0 mode: --/PW res: [0x4393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524132:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524133:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524133:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.524141:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4392:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.524143:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc6c0/0x98871c73fd0e7748 lrc: 3/0,1 mode: --/PW res: [0x4392:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524146:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524147:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524147:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc6c0/0x98871c73fd0e7748 lrc: 3/0,1 mode: PW/PW res: [0x4392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524151:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc6c0/0x98871c73fd0e7748 lrc: 3/0,1 mode: PW/PW res: [0x4392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524160:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc6c0/0x98871c73fd0e7748 lrc: 3/0,1 mode: PW/PW res: [0x4392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524176:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc6c0/0x98871c73fd0e7748 lrc: 2/0,0 mode: PW/PW res: [0x4392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524182:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524187:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524191:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc6c0/0x98871c73fd0e7748 lrc: 2/0,0 mode: PW/PW res: [0x4392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524195:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdc6c0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524196:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc6c0/0x98871c73fd0e7748 lrc: 2/0,0 mode: PW/PW res: [0x4392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524199:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc6c0/0x98871c73fd0e7748 lrc: 3/0,0 mode: PW/PW res: [0x4392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524204:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc6c0/0x98871c73fd0e7748 lrc: 1/0,0 mode: --/PW res: [0x4392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524206:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc6c0/0x98871c73fd0e7748 lrc: 0/0,0 mode: --/PW res: [0x4392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524213:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524213:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524214:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.524215:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4391:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.524217:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd200/0x98871c73fd0e774f lrc: 3/0,1 mode: --/PW res: [0x4391:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524220:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524221:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524222:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd200/0x98871c73fd0e774f lrc: 3/0,1 mode: PW/PW res: [0x4391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524226:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd200/0x98871c73fd0e774f lrc: 3/0,1 mode: PW/PW res: [0x4391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524229:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd200/0x98871c73fd0e774f lrc: 3/0,1 mode: PW/PW res: [0x4391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524232:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd200/0x98871c73fd0e774f lrc: 2/0,0 mode: PW/PW res: [0x4391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524237:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524241:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524242:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd200/0x98871c73fd0e774f lrc: 2/0,0 mode: PW/PW res: [0x4391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524245:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdd200 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524246:0:6822:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd200/0x98871c73fd0e774f lrc: 2/0,0 mode: PW/PW res: [0x4391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524249:0:6822:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd200/0x98871c73fd0e774f lrc: 3/0,0 mode: PW/PW res: [0x4391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524259:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd200/0x98871c73fd0e774f lrc: 1/0,0 mode: --/PW res: [0x4391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1736366108.524261:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4390:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.524262:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd200/0x98871c73fd0e774f lrc: 0/0,0 mode: --/PW res: [0x4391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524266:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf3c0/0x98871c73fd0e7756 lrc: 3/0,1 mode: --/PW res: [0x4390:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524268:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524268:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524269:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.524270:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524271:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524272:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf3c0/0x98871c73fd0e7756 lrc: 3/0,1 mode: PW/PW res: [0x4390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524276:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf3c0/0x98871c73fd0e7756 lrc: 3/0,1 mode: PW/PW res: [0x4390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524279:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf3c0/0x98871c73fd0e7756 lrc: 3/0,1 mode: PW/PW res: [0x4390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524282:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf3c0/0x98871c73fd0e7756 lrc: 2/0,0 mode: PW/PW res: [0x4390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524287:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524292:0:14340:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524293:0:14340:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf3c0/0x98871c73fd0e7756 lrc: 2/0,0 mode: PW/PW res: [0x4390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524295:0:14340:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdf3c0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524296:0:14340:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf3c0/0x98871c73fd0e7756 lrc: 2/0,0 mode: PW/PW res: [0x4390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524300:0:14340:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf3c0/0x98871c73fd0e7756 lrc: 3/0,0 mode: PW/PW res: [0x4390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524304:0:14340:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf3c0/0x98871c73fd0e7756 lrc: 1/0,0 mode: --/PW res: [0x4390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524307:0:14340:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf3c0/0x98871c73fd0e7756 lrc: 0/0,0 mode: --/PW res: [0x4390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524312:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524315:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524316:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.524318:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x438f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.524320:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcd80/0x98871c73fd0e775d lrc: 3/0,1 mode: --/PW res: [0x438f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524323:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524324:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524325:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcd80/0x98871c73fd0e775d lrc: 3/0,1 mode: PW/PW res: [0x438f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524328:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcd80/0x98871c73fd0e775d lrc: 3/0,1 mode: PW/PW res: [0x438f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524337:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcd80/0x98871c73fd0e775d lrc: 3/0,1 mode: PW/PW res: [0x438f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524340:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcd80/0x98871c73fd0e775d lrc: 2/0,0 mode: PW/PW res: [0x438f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524346:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524350:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524351:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcd80/0x98871c73fd0e775d lrc: 2/0,0 mode: PW/PW res: [0x438f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524355:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdcd80 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524356:0:8052:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcd80/0x98871c73fd0e775d lrc: 2/0,0 mode: PW/PW res: [0x438f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524359:0:8052:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcd80/0x98871c73fd0e775d lrc: 3/0,0 mode: PW/PW res: [0x438f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524363:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcd80/0x98871c73fd0e775d lrc: 1/0,0 mode: --/PW res: [0x438f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524366:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcd80/0x98871c73fd0e775d lrc: 0/0,0 mode: --/PW res: [0x438f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524372:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524373:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524373:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.524375:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x438e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.524377:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc480/0x98871c73fd0e7764 lrc: 3/0,1 mode: --/PW res: [0x438e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524380:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524381:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524382:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc480/0x98871c73fd0e7764 lrc: 3/0,1 mode: PW/PW res: [0x438e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524386:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc480/0x98871c73fd0e7764 lrc: 3/0,1 mode: PW/PW res: [0x438e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524389:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc480/0x98871c73fd0e7764 lrc: 3/0,1 mode: PW/PW res: [0x438e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524392:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc480/0x98871c73fd0e7764 lrc: 2/0,0 mode: PW/PW res: [0x438e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524396:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524400:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524401:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc480/0x98871c73fd0e7764 lrc: 2/0,0 mode: PW/PW res: [0x438e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524405:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdc480 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524406:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc480/0x98871c73fd0e7764 lrc: 2/0,0 mode: PW/PW res: [0x438e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524414:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc480/0x98871c73fd0e7764 lrc: 3/0,0 mode: PW/PW res: [0x438e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524419:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc480/0x98871c73fd0e7764 lrc: 1/0,0 mode: --/PW res: [0x438e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524421:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc480/0x98871c73fd0e7764 lrc: 0/0,0 mode: --/PW res: [0x438e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1736366108.524422:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x438d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.524427:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.524427:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd440/0x98871c73fd0e776b lrc: 3/0,1 mode: --/PW res: [0x438d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524428:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524429:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.524432:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524432:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524433:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd440/0x98871c73fd0e776b lrc: 3/0,1 mode: PW/PW res: [0x438d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524438:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd440/0x98871c73fd0e776b lrc: 3/0,1 mode: PW/PW res: [0x438d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524441:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd440/0x98871c73fd0e776b lrc: 3/0,1 mode: PW/PW res: [0x438d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524444:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd440/0x98871c73fd0e776b lrc: 2/0,0 mode: PW/PW res: [0x438d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524449:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524453:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524454:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd440/0x98871c73fd0e776b lrc: 2/0,0 mode: PW/PW res: [0x438d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524457:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdd440 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524458:0:6822:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd440/0x98871c73fd0e776b lrc: 2/0,0 mode: PW/PW res: [0x438d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524461:0:6822:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd440/0x98871c73fd0e776b lrc: 3/0,0 mode: PW/PW res: [0x438d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524465:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd440/0x98871c73fd0e776b lrc: 1/0,0 mode: --/PW res: [0x438d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524468:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdd440/0x98871c73fd0e776b lrc: 0/0,0 mode: --/PW res: [0x438d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524477:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524478:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524479:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.524479:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x438c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.524480:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbde1c0/0x98871c73fd0e7772 lrc: 3/0,1 mode: --/PW res: [0x438c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524483:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524484:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524485:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbde1c0/0x98871c73fd0e7772 lrc: 3/0,1 mode: PW/PW res: [0x438c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524488:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbde1c0/0x98871c73fd0e7772 lrc: 3/0,1 mode: PW/PW res: [0x438c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524497:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbde1c0/0x98871c73fd0e7772 lrc: 3/0,1 mode: PW/PW res: [0x438c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524500:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbde1c0/0x98871c73fd0e7772 lrc: 2/0,0 mode: PW/PW res: [0x438c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524505:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524509:0:14340:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524511:0:14340:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbde1c0/0x98871c73fd0e7772 lrc: 2/0,0 mode: PW/PW res: [0x438c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524514:0:14340:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbde1c0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524515:0:14340:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbde1c0/0x98871c73fd0e7772 lrc: 2/0,0 mode: PW/PW res: [0x438c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524518:0:14340:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbde1c0/0x98871c73fd0e7772 lrc: 3/0,0 mode: PW/PW res: [0x438c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524522:0:14340:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbde1c0/0x98871c73fd0e7772 lrc: 1/0,0 mode: --/PW res: [0x438c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524525:0:14340:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbde1c0/0x98871c73fd0e7772 lrc: 0/0,0 mode: --/PW res: [0x438c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524530:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524531:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524531:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.524544:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x438b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.524547:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf600/0x98871c73fd0e7779 lrc: 3/0,1 mode: --/PW res: [0x438b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524553:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524554:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524555:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf600/0x98871c73fd0e7779 lrc: 3/0,1 mode: PW/PW res: [0x438b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524562:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf600/0x98871c73fd0e7779 lrc: 3/0,1 mode: PW/PW res: [0x438b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524568:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf600/0x98871c73fd0e7779 lrc: 3/0,1 mode: PW/PW res: [0x438b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524573:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf600/0x98871c73fd0e7779 lrc: 2/0,0 mode: PW/PW res: [0x438b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524583:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524586:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524588:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf600/0x98871c73fd0e7779 lrc: 2/0,0 mode: PW/PW res: [0x438b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524591:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdf600 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524594:0:8052:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf600/0x98871c73fd0e7779 lrc: 2/0,0 mode: PW/PW res: [0x438b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524598:0:8052:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf600/0x98871c73fd0e7779 lrc: 3/0,0 mode: PW/PW res: [0x438b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524603:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf600/0x98871c73fd0e7779 lrc: 1/0,0 mode: --/PW res: [0x438b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524605:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf600/0x98871c73fd0e7779 lrc: 0/0,0 mode: --/PW res: [0x438b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524611:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524611:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524612:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.524628:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x438a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.524634:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc240/0x98871c73fd0e7780 lrc: 3/0,1 mode: --/PW res: [0x438a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524647:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524648:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524649:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc240/0x98871c73fd0e7780 lrc: 3/0,1 mode: PW/PW res: [0x438a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524653:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc240/0x98871c73fd0e7780 lrc: 3/0,1 mode: PW/PW res: [0x438a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524657:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc240/0x98871c73fd0e7780 lrc: 3/0,1 mode: PW/PW res: [0x438a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524660:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc240/0x98871c73fd0e7780 lrc: 2/0,0 mode: PW/PW res: [0x438a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524665:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524669:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524671:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc240/0x98871c73fd0e7780 lrc: 2/0,0 mode: PW/PW res: [0x438a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524673:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdc240 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524674:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc240/0x98871c73fd0e7780 lrc: 2/0,0 mode: PW/PW res: [0x438a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524677:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc240/0x98871c73fd0e7780 lrc: 3/0,0 mode: PW/PW res: [0x438a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524681:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc240/0x98871c73fd0e7780 lrc: 1/0,0 mode: --/PW res: [0x438a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524689:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc240/0x98871c73fd0e7780 lrc: 0/0,0 mode: --/PW res: [0x438a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524696:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524696:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524697:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.524697:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4389:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.524699:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7787 lrc: 3/0,1 mode: --/PW res: [0x4389:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524702:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524703:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524703:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7787 lrc: 3/0,1 mode: PW/PW res: [0x4389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524707:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7787 lrc: 3/0,1 mode: PW/PW res: [0x4389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524715:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7787 lrc: 3/0,1 mode: PW/PW res: [0x4389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524718:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7787 lrc: 2/0,0 mode: PW/PW res: [0x4389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524723:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524727:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524728:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7787 lrc: 2/0,0 mode: PW/PW res: [0x4389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524731:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdcfc0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524732:0:6822:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7787 lrc: 2/0,0 mode: PW/PW res: [0x4389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524735:0:6822:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7787 lrc: 3/0,0 mode: PW/PW res: [0x4389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524740:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7787 lrc: 1/0,0 mode: --/PW res: [0x4389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524742:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7787 lrc: 0/0,0 mode: --/PW res: [0x4389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524747:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524748:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524749:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.524786:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4388:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.524788:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc900/0x98871c73fd0e778e lrc: 3/0,1 mode: --/PW res: [0x4388:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524792:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524792:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524793:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc900/0x98871c73fd0e778e lrc: 3/0,1 mode: PW/PW res: [0x4388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524798:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc900/0x98871c73fd0e778e lrc: 3/0,1 mode: PW/PW res: [0x4388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524801:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc900/0x98871c73fd0e778e lrc: 3/0,1 mode: PW/PW res: [0x4388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524804:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc900/0x98871c73fd0e778e lrc: 2/0,0 mode: PW/PW res: [0x4388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524815:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524828:0:14340:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524833:0:14340:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc900/0x98871c73fd0e778e lrc: 2/0,0 mode: PW/PW res: [0x4388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524837:0:14340:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdc900 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524839:0:14340:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc900/0x98871c73fd0e778e lrc: 2/0,0 mode: PW/PW res: [0x4388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524842:0:14340:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc900/0x98871c73fd0e778e lrc: 3/0,0 mode: PW/PW res: [0x4388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524847:0:14340:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc900/0x98871c73fd0e778e lrc: 1/0,0 mode: --/PW res: [0x4388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524851:0:14340:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdc900/0x98871c73fd0e778e lrc: 0/0,0 mode: --/PW res: [0x4388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524858:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524858:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524859:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.524906:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4387:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.524912:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7795 lrc: 3/0,1 mode: --/PW res: [0x4387:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524916:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524917:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524918:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7795 lrc: 3/0,1 mode: PW/PW res: [0x4387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524922:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7795 lrc: 3/0,1 mode: PW/PW res: [0x4387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524925:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7795 lrc: 3/0,1 mode: PW/PW res: [0x4387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524928:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7795 lrc: 2/0,0 mode: PW/PW res: [0x4387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524940:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.524951:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.524953:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7795 lrc: 2/0,0 mode: PW/PW res: [0x4387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524958:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdeac0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.524959:0:8052:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7795 lrc: 2/0,0 mode: PW/PW res: [0x4387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524962:0:8052:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7795 lrc: 3/0,0 mode: PW/PW res: [0x4387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1736366108.524972:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4386:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.524974:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7795 lrc: 1/0,0 mode: --/PW res: [0x4387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524974:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfcc0/0x98871c73fd0e779c lrc: 3/0,1 mode: --/PW res: [0x4386:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524978:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7795 lrc: 0/0,0 mode: --/PW res: [0x4387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524978:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524978:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.524979:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfcc0/0x98871c73fd0e779c lrc: 3/0,1 mode: PW/PW res: [0x4386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524983:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfcc0/0x98871c73fd0e779c lrc: 3/0,1 mode: PW/PW res: [0x4386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.524985:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524985:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.524986:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.524991:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfcc0/0x98871c73fd0e779c lrc: 3/0,1 mode: PW/PW res: [0x4386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.524995:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfcc0/0x98871c73fd0e779c lrc: 2/0,0 mode: PW/PW res: [0x4386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525000:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.525004:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.525005:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfcc0/0x98871c73fd0e779c lrc: 2/0,0 mode: PW/PW res: [0x4386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525009:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdfcc0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.525010:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfcc0/0x98871c73fd0e779c lrc: 2/0,0 mode: PW/PW res: [0x4386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525013:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfcc0/0x98871c73fd0e779c lrc: 3/0,0 mode: PW/PW res: [0x4386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525017:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfcc0/0x98871c73fd0e779c lrc: 1/0,0 mode: --/PW res: [0x4386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525019:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdfcc0/0x98871c73fd0e779c lrc: 0/0,0 mode: --/PW res: [0x4386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525026:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.525029:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.525030:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.525030:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4385:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.525031:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbde880/0x98871c73fd0e77a3 lrc: 3/0,1 mode: --/PW res: [0x4385:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525035:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.525035:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.525036:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbde880/0x98871c73fd0e77a3 lrc: 3/0,1 mode: PW/PW res: [0x4385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525039:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbde880/0x98871c73fd0e77a3 lrc: 3/0,1 mode: PW/PW res: [0x4385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525042:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbde880/0x98871c73fd0e77a3 lrc: 3/0,1 mode: PW/PW res: [0x4385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525045:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbde880/0x98871c73fd0e77a3 lrc: 2/0,0 mode: PW/PW res: [0x4385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525050:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.525054:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.525055:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbde880/0x98871c73fd0e77a3 lrc: 2/0,0 mode: PW/PW res: [0x4385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525060:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbde880 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.525061:0:6822:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbde880/0x98871c73fd0e77a3 lrc: 2/0,0 mode: PW/PW res: [0x4385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525064:0:6822:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbde880/0x98871c73fd0e77a3 lrc: 3/0,0 mode: PW/PW res: [0x4385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525068:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbde880/0x98871c73fd0e77a3 lrc: 1/0,0 mode: --/PW res: [0x4385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525071:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbde880/0x98871c73fd0e77a3 lrc: 0/0,0 mode: --/PW res: [0x4385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1736366108.525075:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4384:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.525077:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.525077:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.525078:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.525079:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf840/0x98871c73fd0e77aa lrc: 3/0,1 mode: --/PW res: [0x4384:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525083:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.525084:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.525085:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf840/0x98871c73fd0e77aa lrc: 3/0,1 mode: PW/PW res: [0x4384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525089:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf840/0x98871c73fd0e77aa lrc: 3/0,1 mode: PW/PW res: [0x4384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525092:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf840/0x98871c73fd0e77aa lrc: 3/0,1 mode: PW/PW res: [0x4384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525095:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf840/0x98871c73fd0e77aa lrc: 2/0,0 mode: PW/PW res: [0x4384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525100:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.525104:0:14340:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.525105:0:14340:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf840/0x98871c73fd0e77aa lrc: 2/0,0 mode: PW/PW res: [0x4384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525109:0:14340:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdf840 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.525110:0:14340:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf840/0x98871c73fd0e77aa lrc: 2/0,0 mode: PW/PW res: [0x4384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525119:0:14340:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf840/0x98871c73fd0e77aa lrc: 3/0,0 mode: PW/PW res: [0x4384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525124:0:14340:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf840/0x98871c73fd0e77aa lrc: 1/0,0 mode: --/PW res: [0x4384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525126:0:14340:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbdf840/0x98871c73fd0e77aa lrc: 0/0,0 mode: --/PW res: [0x4384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1736366108.525128:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4383:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.525130:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbde400/0x98871c73fd0e77b1 lrc: 3/0,1 mode: --/PW res: [0x4383:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525132:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.525133:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.525133:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366108.525134:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.525134:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.525135:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbde400/0x98871c73fd0e77b1 lrc: 3/0,1 mode: PW/PW res: [0x4383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525138:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbde400/0x98871c73fd0e77b1 lrc: 3/0,1 mode: PW/PW res: [0x4383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525147:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbde400/0x98871c73fd0e77b1 lrc: 3/0,1 mode: PW/PW res: [0x4383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525150:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbde400/0x98871c73fd0e77b1 lrc: 2/0,0 mode: PW/PW res: [0x4383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525155:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.525171:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.525173:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbde400/0x98871c73fd0e77b1 lrc: 2/0,0 mode: PW/PW res: [0x4383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525176:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbde400 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.525176:0:8052:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbde400/0x98871c73fd0e77b1 lrc: 2/0,0 mode: PW/PW res: [0x4383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525179:0:8052:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbde400/0x98871c73fd0e77b1 lrc: 3/0,0 mode: PW/PW res: [0x4383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525184:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbde400/0x98871c73fd0e77b1 lrc: 1/0,0 mode: --/PW res: [0x4383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525187:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbde400/0x98871c73fd0e77b1 lrc: 0/0,0 mode: --/PW res: [0x4383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525196:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.525197:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.525198:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1736366108.525203:0:9254:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x4382:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1736366108.525204:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbddd40/0x98871c73fd0e77b8 lrc: 3/0,1 mode: --/PW res: [0x4382:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525208:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.525208:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1736366108.525210:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbddd40/0x98871c73fd0e77b8 lrc: 3/0,1 mode: PW/PW res: [0x4382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525214:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbddd40/0x98871c73fd0e77b8 lrc: 3/0,1 mode: PW/PW res: [0x4382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525217:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbddd40/0x98871c73fd0e77b8 lrc: 3/0,1 mode: PW/PW res: [0x4382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525220:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbddd40/0x98871c73fd0e77b8 lrc: 2/0,0 mode: PW/PW res: [0x4382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366108.525224:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.525229:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.525230:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbddd40/0x98871c73fd0e77b8 lrc: 2/0,0 mode: PW/PW res: [0x4382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525233:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbddd40 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.525234:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbddd40/0x98871c73fd0e77b8 lrc: 2/0,0 mode: PW/PW res: [0x4382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525237:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbddd40/0x98871c73fd0e77b8 lrc: 3/0,0 mode: PW/PW res: [0x4382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525241:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbddd40/0x98871c73fd0e77b8 lrc: 1/0,0 mode: --/PW res: [0x4382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525244:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbddd40/0x98871c73fd0e77b8 lrc: 0/0,0 mode: --/PW res: [0x4382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525249:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.525250:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.525251:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366108.525806:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736366108.525812:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4609:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.525816:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99680/0x98871c73fd0e77bf lrc: 3/0,1 mode: --/PW res: [0x4609:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.525822:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.525823:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.525824:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99680/0x98871c73fd0e77bf lrc: 3/0,1 mode: PW/PW res: [0x4609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.525840:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99680/0x98871c73fd0e77bf lrc: 3/0,1 mode: PW/PW res: [0x4609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.525844:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99680/0x98871c73fd0e77bf lrc: 3/0,1 mode: PW/PW res: [0x4609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.525847:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99680/0x98871c73fd0e77bf lrc: 2/0,0 mode: PW/PW res: [0x4609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.525860:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.525888:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.525892:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99680/0x98871c73fd0e77bf lrc: 2/0,0 mode: PW/PW res: [0x4609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525898:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d99680 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.525904:0:6822:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99680/0x98871c73fd0e77bf lrc: 2/0,0 mode: PW/PW res: [0x4609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525909:0:6822:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99680/0x98871c73fd0e77bf lrc: 3/0,0 mode: PW/PW res: [0x4609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525917:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99680/0x98871c73fd0e77bf lrc: 1/0,0 mode: --/PW res: [0x4609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525919:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99680/0x98871c73fd0e77bf lrc: 0/0,0 mode: --/PW res: [0x4609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736366108.525941:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4608:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.525943:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.525943:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.525944:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.525948:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a1c0/0x98871c73fd0e77c6 lrc: 3/0,1 mode: --/PW res: [0x4608:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.525952:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.525953:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.525954:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a1c0/0x98871c73fd0e77c6 lrc: 3/0,1 mode: PW/PW res: [0x4608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.525959:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a1c0/0x98871c73fd0e77c6 lrc: 3/0,1 mode: PW/PW res: [0x4608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.525962:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a1c0/0x98871c73fd0e77c6 lrc: 3/0,1 mode: PW/PW res: [0x4608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.525965:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a1c0/0x98871c73fd0e77c6 lrc: 2/0,0 mode: PW/PW res: [0x4608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.525971:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.525976:0:14340:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.525977:0:14340:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a1c0/0x98871c73fd0e77c6 lrc: 2/0,0 mode: PW/PW res: [0x4608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525981:0:14340:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d9a1c0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.525982:0:14340:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a1c0/0x98871c73fd0e77c6 lrc: 2/0,0 mode: PW/PW res: [0x4608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525985:0:14340:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a1c0/0x98871c73fd0e77c6 lrc: 3/0,0 mode: PW/PW res: [0x4608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525989:0:14340:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a1c0/0x98871c73fd0e77c6 lrc: 1/0,0 mode: --/PW res: [0x4608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.525998:0:14340:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a1c0/0x98871c73fd0e77c6 lrc: 0/0,0 mode: --/PW res: [0x4608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526005:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526005:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736366108.526006:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4607:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.526006:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.526008:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d986c0/0x98871c73fd0e77cd lrc: 3/0,1 mode: --/PW res: [0x4607:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526012:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526012:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526013:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d986c0/0x98871c73fd0e77cd lrc: 3/0,1 mode: PW/PW res: [0x4607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526016:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d986c0/0x98871c73fd0e77cd lrc: 3/0,1 mode: PW/PW res: [0x4607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526026:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d986c0/0x98871c73fd0e77cd lrc: 3/0,1 mode: PW/PW res: [0x4607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526029:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d986c0/0x98871c73fd0e77cd lrc: 2/0,0 mode: PW/PW res: [0x4607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526034:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.526038:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.526040:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d986c0/0x98871c73fd0e77cd lrc: 2/0,0 mode: PW/PW res: [0x4607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526043:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d986c0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.526044:0:8052:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d986c0/0x98871c73fd0e77cd lrc: 2/0,0 mode: PW/PW res: [0x4607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526047:0:8052:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d986c0/0x98871c73fd0e77cd lrc: 3/0,0 mode: PW/PW res: [0x4607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526051:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d986c0/0x98871c73fd0e77cd lrc: 1/0,0 mode: --/PW res: [0x4607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526054:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d986c0/0x98871c73fd0e77cd lrc: 0/0,0 mode: --/PW res: [0x4607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526060:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526061:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526061:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736366108.526067:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4606:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.526068:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b180/0x98871c73fd0e77d4 lrc: 3/0,1 mode: --/PW res: [0x4606:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526071:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526072:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526073:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b180/0x98871c73fd0e77d4 lrc: 3/0,1 mode: PW/PW res: [0x4606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526077:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b180/0x98871c73fd0e77d4 lrc: 3/0,1 mode: PW/PW res: [0x4606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526080:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b180/0x98871c73fd0e77d4 lrc: 3/0,1 mode: PW/PW res: [0x4606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526083:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b180/0x98871c73fd0e77d4 lrc: 2/0,0 mode: PW/PW res: [0x4606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526088:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.526092:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.526096:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b180/0x98871c73fd0e77d4 lrc: 2/0,0 mode: PW/PW res: [0x4606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526099:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d9b180 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.526100:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b180/0x98871c73fd0e77d4 lrc: 2/0,0 mode: PW/PW res: [0x4606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526103:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b180/0x98871c73fd0e77d4 lrc: 3/0,0 mode: PW/PW res: [0x4606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526107:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b180/0x98871c73fd0e77d4 lrc: 1/0,0 mode: --/PW res: [0x4606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526110:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b180/0x98871c73fd0e77d4 lrc: 0/0,0 mode: --/PW res: [0x4606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736366108.526114:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4605:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.526116:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526117:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526117:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.526119:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ba80/0x98871c73fd0e77db lrc: 3/0,1 mode: --/PW res: [0x4605:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526123:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526124:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526125:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ba80/0x98871c73fd0e77db lrc: 3/0,1 mode: PW/PW res: [0x4605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526129:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ba80/0x98871c73fd0e77db lrc: 3/0,1 mode: PW/PW res: [0x4605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526132:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ba80/0x98871c73fd0e77db lrc: 3/0,1 mode: PW/PW res: [0x4605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526135:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ba80/0x98871c73fd0e77db lrc: 2/0,0 mode: PW/PW res: [0x4605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526146:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1736366108.526198:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4604:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1736366108.526198:0:10475:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1736366108.526200:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d998c0/0x98871c73fd0e77e2 lrc: 3/0,1 mode: --/PW res: [0x4604:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526202:0:10475:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ba80/0x98871c73fd0e77db lrc: 2/0,0 mode: PW/PW res: [0x4605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526204:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526204:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526205:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d998c0/0x98871c73fd0e77e2 lrc: 3/0,1 mode: PW/PW res: [0x4604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526208:0:10475:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d9ba80 already unused, calling callback (ffffffffa0811190) 00010000:00010000:0.0:1736366108.526209:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d998c0/0x98871c73fd0e77e2 lrc: 3/0,1 mode: PW/PW res: [0x4604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526209:0:10475:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ba80/0x98871c73fd0e77db lrc: 2/0,0 mode: PW/PW res: [0x4605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526213:0:10475:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ba80/0x98871c73fd0e77db lrc: 3/0,0 mode: PW/PW res: [0x4605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526218:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d998c0/0x98871c73fd0e77e2 lrc: 3/0,1 mode: PW/PW res: [0x4604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526221:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d998c0/0x98871c73fd0e77e2 lrc: 2/0,0 mode: PW/PW res: [0x4604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526221:0:10475:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ba80/0x98871c73fd0e77db lrc: 1/0,0 mode: --/PW res: [0x4605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526225:0:10475:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ba80/0x98871c73fd0e77db lrc: 0/0,0 mode: --/PW res: [0x4605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526226:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.526229:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.526231:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d998c0/0x98871c73fd0e77e2 lrc: 2/0,0 mode: PW/PW res: [0x4604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526234:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526235:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d998c0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:3.0:1736366108.526235:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366108.526235:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526236:0:6822:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d998c0/0x98871c73fd0e77e2 lrc: 2/0,0 mode: PW/PW res: [0x4604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526239:0:6822:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d998c0/0x98871c73fd0e77e2 lrc: 3/0,0 mode: PW/PW res: [0x4604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526251:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d998c0/0x98871c73fd0e77e2 lrc: 1/0,0 mode: --/PW res: [0x4604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526254:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d998c0/0x98871c73fd0e77e2 lrc: 0/0,0 mode: --/PW res: [0x4604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736366108.526261:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4603:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.526263:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b3c0/0x98871c73fd0e77e9 lrc: 3/0,1 mode: --/PW res: [0x4603:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526263:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526263:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526264:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.526266:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526266:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526267:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b3c0/0x98871c73fd0e77e9 lrc: 3/0,1 mode: PW/PW res: [0x4603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526271:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b3c0/0x98871c73fd0e77e9 lrc: 3/0,1 mode: PW/PW res: [0x4603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526274:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b3c0/0x98871c73fd0e77e9 lrc: 3/0,1 mode: PW/PW res: [0x4603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526277:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b3c0/0x98871c73fd0e77e9 lrc: 2/0,0 mode: PW/PW res: [0x4603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526292:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.526294:0:14340:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.526295:0:14340:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b3c0/0x98871c73fd0e77e9 lrc: 2/0,0 mode: PW/PW res: [0x4603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526299:0:14340:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d9b3c0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.526300:0:14340:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b3c0/0x98871c73fd0e77e9 lrc: 2/0,0 mode: PW/PW res: [0x4603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526303:0:14340:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b3c0/0x98871c73fd0e77e9 lrc: 3/0,0 mode: PW/PW res: [0x4603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526307:0:14340:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b3c0/0x98871c73fd0e77e9 lrc: 1/0,0 mode: --/PW res: [0x4603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526309:0:14340:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b3c0/0x98871c73fd0e77e9 lrc: 0/0,0 mode: --/PW res: [0x4603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526315:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526319:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736366108.526320:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4602:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.526320:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.526324:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98240/0x98871c73fd0e77f0 lrc: 3/0,1 mode: --/PW res: [0x4602:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526328:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526329:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526330:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98240/0x98871c73fd0e77f0 lrc: 3/0,1 mode: PW/PW res: [0x4602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526334:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98240/0x98871c73fd0e77f0 lrc: 3/0,1 mode: PW/PW res: [0x4602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526337:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98240/0x98871c73fd0e77f0 lrc: 3/0,1 mode: PW/PW res: [0x4602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526339:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98240/0x98871c73fd0e77f0 lrc: 2/0,0 mode: PW/PW res: [0x4602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526345:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.526346:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.526348:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98240/0x98871c73fd0e77f0 lrc: 2/0,0 mode: PW/PW res: [0x4602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526352:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d98240 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.526352:0:8052:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98240/0x98871c73fd0e77f0 lrc: 2/0,0 mode: PW/PW res: [0x4602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526356:0:8052:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98240/0x98871c73fd0e77f0 lrc: 3/0,0 mode: PW/PW res: [0x4602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526360:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98240/0x98871c73fd0e77f0 lrc: 1/0,0 mode: --/PW res: [0x4602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526363:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98240/0x98871c73fd0e77f0 lrc: 0/0,0 mode: --/PW res: [0x4602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526369:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526369:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526370:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736366108.526376:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4601:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.526378:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98b40/0x98871c73fd0e77f7 lrc: 3/0,1 mode: --/PW res: [0x4601:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526381:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526382:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526383:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98b40/0x98871c73fd0e77f7 lrc: 3/0,1 mode: PW/PW res: [0x4601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526386:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98b40/0x98871c73fd0e77f7 lrc: 3/0,1 mode: PW/PW res: [0x4601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526394:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98b40/0x98871c73fd0e77f7 lrc: 3/0,1 mode: PW/PW res: [0x4601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526397:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98b40/0x98871c73fd0e77f7 lrc: 2/0,0 mode: PW/PW res: [0x4601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526403:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.526404:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.526405:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98b40/0x98871c73fd0e77f7 lrc: 2/0,0 mode: PW/PW res: [0x4601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526408:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d98b40 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.526409:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98b40/0x98871c73fd0e77f7 lrc: 2/0,0 mode: PW/PW res: [0x4601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526417:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98b40/0x98871c73fd0e77f7 lrc: 3/0,0 mode: PW/PW res: [0x4601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526423:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98b40/0x98871c73fd0e77f7 lrc: 1/0,0 mode: --/PW res: [0x4601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526425:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98b40/0x98871c73fd0e77f7 lrc: 0/0,0 mode: --/PW res: [0x4601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526431:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526432:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526433:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736366108.526435:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x4600:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.526436:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ad00/0x98871c73fd0e77fe lrc: 3/0,1 mode: --/PW res: [0x4600:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526439:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526440:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526441:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ad00/0x98871c73fd0e77fe lrc: 3/0,1 mode: PW/PW res: [0x4600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526444:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ad00/0x98871c73fd0e77fe lrc: 3/0,1 mode: PW/PW res: [0x4600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526447:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ad00/0x98871c73fd0e77fe lrc: 3/0,1 mode: PW/PW res: [0x4600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526450:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ad00/0x98871c73fd0e77fe lrc: 2/0,0 mode: PW/PW res: [0x4600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526460:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736366108.526474:0:10475:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736366108.526476:0:10475:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ad00/0x98871c73fd0e77fe lrc: 2/0,0 mode: PW/PW res: [0x4600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526487:0:10475:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d9ad00 already unused, calling callback (ffffffffa0811190) 00010000:00010000:3.0:1736366108.526489:0:10475:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ad00/0x98871c73fd0e77fe lrc: 2/0,0 mode: PW/PW res: [0x4600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736366108.526492:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1736366108.526492:0:10475:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ad00/0x98871c73fd0e77fe lrc: 3/0,0 mode: PW/PW res: [0x4600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526497:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98900/0x98871c73fd0e7805 lrc: 3/0,1 mode: --/PW res: [0x45ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526498:0:10475:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ad00/0x98871c73fd0e77fe lrc: 1/0,0 mode: --/PW res: [0x4600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526501:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1736366108.526501:0:10475:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9ad00/0x98871c73fd0e77fe lrc: 0/0,0 mode: --/PW res: [0x4600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526502:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526503:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98900/0x98871c73fd0e7805 lrc: 3/0,1 mode: PW/PW res: [0x45ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526507:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98900/0x98871c73fd0e7805 lrc: 3/0,1 mode: PW/PW res: [0x45ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526509:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.526510:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98900/0x98871c73fd0e7805 lrc: 3/0,1 mode: PW/PW res: [0x45ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526510:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366108.526511:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.526513:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98900/0x98871c73fd0e7805 lrc: 2/0,0 mode: PW/PW res: [0x45ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526523:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.526532:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.526534:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98900/0x98871c73fd0e7805 lrc: 2/0,0 mode: PW/PW res: [0x45ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526537:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d98900 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.526538:0:6822:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98900/0x98871c73fd0e7805 lrc: 2/0,0 mode: PW/PW res: [0x45ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526541:0:6822:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98900/0x98871c73fd0e7805 lrc: 3/0,0 mode: PW/PW res: [0x45ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526547:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98900/0x98871c73fd0e7805 lrc: 1/0,0 mode: --/PW res: [0x45ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526549:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98900/0x98871c73fd0e7805 lrc: 0/0,0 mode: --/PW res: [0x45ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736366108.526557:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.526559:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98d80/0x98871c73fd0e780c lrc: 3/0,1 mode: --/PW res: [0x45fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526561:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526561:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.526562:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526562:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736366108.526562:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.526563:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98d80/0x98871c73fd0e780c lrc: 3/0,1 mode: PW/PW res: [0x45fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526567:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98d80/0x98871c73fd0e780c lrc: 3/0,1 mode: PW/PW res: [0x45fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526575:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98d80/0x98871c73fd0e780c lrc: 3/0,1 mode: PW/PW res: [0x45fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526578:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98d80/0x98871c73fd0e780c lrc: 2/0,0 mode: PW/PW res: [0x45fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526583:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.526585:0:14340:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.526587:0:14340:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98d80/0x98871c73fd0e780c lrc: 2/0,0 mode: PW/PW res: [0x45fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526590:0:14340:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d98d80 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.526591:0:14340:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98d80/0x98871c73fd0e780c lrc: 2/0,0 mode: PW/PW res: [0x45fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526594:0:14340:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98d80/0x98871c73fd0e780c lrc: 3/0,0 mode: PW/PW res: [0x45fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526598:0:14340:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98d80/0x98871c73fd0e780c lrc: 1/0,0 mode: --/PW res: [0x45fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526601:0:14340:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d98d80/0x98871c73fd0e780c lrc: 0/0,0 mode: --/PW res: [0x45fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526607:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526607:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526608:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736366108.526617:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.526618:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a640/0x98871c73fd0e7813 lrc: 3/0,1 mode: --/PW res: [0x45fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526622:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526622:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526623:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a640/0x98871c73fd0e7813 lrc: 3/0,1 mode: PW/PW res: [0x45fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526627:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a640/0x98871c73fd0e7813 lrc: 3/0,1 mode: PW/PW res: [0x45fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526630:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a640/0x98871c73fd0e7813 lrc: 3/0,1 mode: PW/PW res: [0x45fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526633:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a640/0x98871c73fd0e7813 lrc: 2/0,0 mode: PW/PW res: [0x45fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526638:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.526639:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.526640:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a640/0x98871c73fd0e7813 lrc: 2/0,0 mode: PW/PW res: [0x45fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526644:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d9a640 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.526647:0:8052:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a640/0x98871c73fd0e7813 lrc: 2/0,0 mode: PW/PW res: [0x45fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526651:0:8052:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a640/0x98871c73fd0e7813 lrc: 3/0,0 mode: PW/PW res: [0x45fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526655:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a640/0x98871c73fd0e7813 lrc: 1/0,0 mode: --/PW res: [0x45fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526658:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a640/0x98871c73fd0e7813 lrc: 0/0,0 mode: --/PW res: [0x45fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736366108.526663:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.526665:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526666:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526666:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.526667:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a400/0x98871c73fd0e781a lrc: 3/0,1 mode: --/PW res: [0x45fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526671:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526672:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526673:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a400/0x98871c73fd0e781a lrc: 3/0,1 mode: PW/PW res: [0x45fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526677:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a400/0x98871c73fd0e781a lrc: 3/0,1 mode: PW/PW res: [0x45fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526680:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a400/0x98871c73fd0e781a lrc: 3/0,1 mode: PW/PW res: [0x45fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526683:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a400/0x98871c73fd0e781a lrc: 2/0,0 mode: PW/PW res: [0x45fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526688:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.526689:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.526691:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a400/0x98871c73fd0e781a lrc: 2/0,0 mode: PW/PW res: [0x45fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526693:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d9a400 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.526694:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a400/0x98871c73fd0e781a lrc: 2/0,0 mode: PW/PW res: [0x45fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526697:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a400/0x98871c73fd0e781a lrc: 3/0,0 mode: PW/PW res: [0x45fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526702:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a400/0x98871c73fd0e781a lrc: 1/0,0 mode: --/PW res: [0x45fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526710:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a400/0x98871c73fd0e781a lrc: 0/0,0 mode: --/PW res: [0x45fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526717:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526717:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526718:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736366108.526720:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.526721:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a880/0x98871c73fd0e7821 lrc: 3/0,1 mode: --/PW res: [0x45fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526724:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526725:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526726:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a880/0x98871c73fd0e7821 lrc: 3/0,1 mode: PW/PW res: [0x45fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526729:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a880/0x98871c73fd0e7821 lrc: 3/0,1 mode: PW/PW res: [0x45fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526737:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a880/0x98871c73fd0e7821 lrc: 3/0,1 mode: PW/PW res: [0x45fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526740:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a880/0x98871c73fd0e7821 lrc: 2/0,0 mode: PW/PW res: [0x45fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1736366108.526750:0:9254:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x0:16784 00010000:00010000:0.0:1736366108.526751:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736366108.526784:0:10475:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736366108.526786:0:10475:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a880/0x98871c73fd0e7821 lrc: 2/0,0 mode: PW/PW res: [0x45fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526790:0:10475:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d9a880 already unused, calling callback (ffffffffa0811190) 00010000:00010000:3.0:1736366108.526792:0:10475:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a880/0x98871c73fd0e7821 lrc: 2/0,0 mode: PW/PW res: [0x45fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1736366108.526793:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086935a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:16284:x1820703013013120:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5702us (5771us total) trans 0 rc 0/0 00010000:00010000:3.0:1736366108.526795:0:10475:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a880/0x98871c73fd0e7821 lrc: 3/0,0 mode: PW/PW res: [0x45fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1736366108.526798:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94686 00002000:00010000:0.0:1736366108.526800:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.526802:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b600/0x98871c73fd0e7828 lrc: 3/0,1 mode: --/PW res: [0x45fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526806:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526806:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526807:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b600/0x98871c73fd0e7828 lrc: 3/0,1 mode: PW/PW res: [0x45fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526808:0:10475:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a880/0x98871c73fd0e7821 lrc: 1/0,0 mode: --/PW res: [0x45fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526811:0:10475:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9a880/0x98871c73fd0e7821 lrc: 0/0,0 mode: --/PW res: [0x45fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526812:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b600/0x98871c73fd0e7828 lrc: 3/0,1 mode: PW/PW res: [0x45fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526815:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b600/0x98871c73fd0e7828 lrc: 3/0,1 mode: PW/PW res: [0x45fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526817:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b600/0x98871c73fd0e7828 lrc: 2/0,0 mode: PW/PW res: [0x45fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.526819:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366108.526819:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366108.526820:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.526828:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1736366108.526828:0:16284:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095174740 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16284:1820703013013120:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1736366108.526834:0:16284:0:(osp_precreate.c:953:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x43a1:0x0] from OST, last_created [0x100010000:0x43a1:0x0]last_used is [0x100010000:0x4190:0x0] 00010000:00010000:1.0:1736366108.526837:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.526839:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b600/0x98871c73fd0e7828 lrc: 2/0,0 mode: PW/PW res: [0x45fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526842:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d9b600 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.526843:0:6822:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b600/0x98871c73fd0e7828 lrc: 2/0,0 mode: PW/PW res: [0x45fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526847:0:6822:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b600/0x98871c73fd0e7828 lrc: 3/0,0 mode: PW/PW res: [0x45fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526852:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b600/0x98871c73fd0e7828 lrc: 1/0,0 mode: --/PW res: [0x45fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526855:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b600/0x98871c73fd0e7828 lrc: 0/0,0 mode: --/PW res: [0x45fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736366108.526860:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.526861:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526862:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526863:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.526867:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b840/0x98871c73fd0e782f lrc: 3/0,1 mode: --/PW res: [0x45f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526871:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526871:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.526872:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b840/0x98871c73fd0e782f lrc: 3/0,1 mode: PW/PW res: [0x45f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1736366108.526872:0:16284:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800869c7200 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16284:1820703013013248:0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1736366108.526876:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b840/0x98871c73fd0e782f lrc: 3/0,1 mode: PW/PW res: [0x45f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1736366108.526876:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800869c4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3325:1820703013013184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1736366108.526879:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b840/0x98871c73fd0e782f lrc: 3/0,1 mode: PW/PW res: [0x45f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.526882:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b840/0x98871c73fd0e782f lrc: 2/0,0 mode: PW/PW res: [0x45f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1736366108.526885:0:16284:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366108.526892:0:16284:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5792b40 going to sleep for 20 seconds 00010000:00010000:0.0:1736366108.526894:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.526896:0:14340:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1736366108.526898:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1736366108.526900:0:14340:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b840/0x98871c73fd0e782f lrc: 2/0,0 mode: PW/PW res: [0x45f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1736366108.526900:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013248 00010000:00010000:1.0:1736366108.526904:0:14340:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d9b840 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.526904:0:14340:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b840/0x98871c73fd0e782f lrc: 2/0,0 mode: PW/PW res: [0x45f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.526907:0:14340:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b840/0x98871c73fd0e782f lrc: 3/0,0 mode: PW/PW res: [0x45f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1736366108.526910:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94688 00010000:00010000:1.0:1736366108.526912:0:14340:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b840/0x98871c73fd0e782f lrc: 1/0,0 mode: --/PW res: [0x45f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1736366108.526912:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:16284:x1820703013013248:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1736366108.526915:0:14340:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d9b840/0x98871c73fd0e782f lrc: 0/0,0 mode: --/PW res: [0x45f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00000020:02000000:2.0:1736366108.526915:0:9254:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736366108.526921:0:9256:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013184 00010000:00010000:1.0:1736366108.526921:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526922:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.526922:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1736366108.526927:0:9254:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x0 at 17314 00000100:00100000:0.0:1736366108.526935:0:9256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5826 00000100:00100000:0.0:1736366108.526938:0:9256:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3325:x1820703013013184:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:0.0:1736366108.526940:0:9256:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1736366108.526947:0:9256:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 217280 pending 896 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366108.526970:0:9256:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3325:x1820703013013184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366108.526974:0:9256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5826 00000100:00100000:3.0:1736366108.526981:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800869c4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3325:1820703013013184:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1736366108.527013:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.527015:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99d40/0x98871c73fd0e7836 lrc: 3/0,1 mode: --/PW res: [0x45f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527026:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527027:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527028:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99d40/0x98871c73fd0e7836 lrc: 3/0,1 mode: PW/PW res: [0x45f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527032:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99d40/0x98871c73fd0e7836 lrc: 3/0,1 mode: PW/PW res: [0x45f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527036:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99d40/0x98871c73fd0e7836 lrc: 3/0,1 mode: PW/PW res: [0x45f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527038:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99d40/0x98871c73fd0e7836 lrc: 2/0,0 mode: PW/PW res: [0x45f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527051:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.527059:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.527060:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99d40/0x98871c73fd0e7836 lrc: 2/0,0 mode: PW/PW res: [0x45f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527064:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8d99d40 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.527065:0:8052:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99d40/0x98871c73fd0e7836 lrc: 2/0,0 mode: PW/PW res: [0x45f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527069:0:8052:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99d40/0x98871c73fd0e7836 lrc: 3/0,0 mode: PW/PW res: [0x45f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527080:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99d40/0x98871c73fd0e7836 lrc: 1/0,0 mode: --/PW res: [0x45f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527084:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99d40/0x98871c73fd0e7836 lrc: 0/0,0 mode: --/PW res: [0x45f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736366108.527088:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.527090:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084139680/0x98871c73fd0e783d lrc: 3/0,1 mode: --/PW res: [0x45f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527090:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527091:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527092:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.527094:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527095:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527095:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084139680/0x98871c73fd0e783d lrc: 3/0,1 mode: PW/PW res: [0x45f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527099:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084139680/0x98871c73fd0e783d lrc: 3/0,1 mode: PW/PW res: [0x45f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527103:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084139680/0x98871c73fd0e783d lrc: 3/0,1 mode: PW/PW res: [0x45f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527109:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880084139680/0x98871c73fd0e783d lrc: 2/0,0 mode: PW/PW res: [0x45f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527114:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.527116:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.527117:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880084139680/0x98871c73fd0e783d lrc: 2/0,0 mode: PW/PW res: [0x45f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527121:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880084139680 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.527122:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880084139680/0x98871c73fd0e783d lrc: 2/0,0 mode: PW/PW res: [0x45f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527124:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880084139680/0x98871c73fd0e783d lrc: 3/0,0 mode: PW/PW res: [0x45f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527128:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880084139680/0x98871c73fd0e783d lrc: 1/0,0 mode: --/PW res: [0x45f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527131:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084139680/0x98871c73fd0e783d lrc: 0/0,0 mode: --/PW res: [0x45f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527136:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527139:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527140:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736366108.527147:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.527148:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008413b600/0x98871c73fd0e7844 lrc: 3/0,1 mode: --/PW res: [0x45f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527152:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527153:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527154:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008413b600/0x98871c73fd0e7844 lrc: 3/0,1 mode: PW/PW res: [0x45f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527157:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008413b600/0x98871c73fd0e7844 lrc: 3/0,1 mode: PW/PW res: [0x45f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527160:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008413b600/0x98871c73fd0e7844 lrc: 3/0,1 mode: PW/PW res: [0x45f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527177:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008413b600/0x98871c73fd0e7844 lrc: 2/0,0 mode: PW/PW res: [0x45f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527194:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1736366108.527225:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.527227:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008413b180/0x98871c73fd0e784b lrc: 3/0,1 mode: --/PW res: [0x45f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527229:0:10475:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1736366108.527231:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1736366108.527231:0:10475:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008413b600/0x98871c73fd0e7844 lrc: 2/0,0 mode: PW/PW res: [0x45f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527235:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527236:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008413b180/0x98871c73fd0e784b lrc: 3/0,1 mode: PW/PW res: [0x45f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527236:0:10475:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008413b600 already unused, calling callback (ffffffffa0811190) 00010000:00010000:3.0:1736366108.527237:0:10475:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008413b600/0x98871c73fd0e7844 lrc: 2/0,0 mode: PW/PW res: [0x45f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527240:0:10475:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008413b600/0x98871c73fd0e7844 lrc: 3/0,0 mode: PW/PW res: [0x45f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527241:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008413b180/0x98871c73fd0e784b lrc: 3/0,1 mode: PW/PW res: [0x45f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527244:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008413b180/0x98871c73fd0e784b lrc: 3/0,1 mode: PW/PW res: [0x45f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527246:0:10475:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008413b600/0x98871c73fd0e7844 lrc: 1/0,0 mode: --/PW res: [0x45f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527248:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008413b180/0x98871c73fd0e784b lrc: 2/0,0 mode: PW/PW res: [0x45f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527253:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736366108.527255:0:10475:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008413b600/0x98871c73fd0e7844 lrc: 0/0,0 mode: --/PW res: [0x45f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527257:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.527259:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008413b180/0x98871c73fd0e784b lrc: 2/0,0 mode: PW/PW res: [0x45f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527263:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366108.527263:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527264:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008413b180 already unused, calling callback (ffffffffa0811190) 00010000:00010000:3.0:1736366108.527264:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527265:0:6822:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008413b180/0x98871c73fd0e784b lrc: 2/0,0 mode: PW/PW res: [0x45f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527268:0:6822:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008413b180/0x98871c73fd0e784b lrc: 3/0,0 mode: PW/PW res: [0x45f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527274:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008413b180/0x98871c73fd0e784b lrc: 1/0,0 mode: --/PW res: [0x45f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527277:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008413b180/0x98871c73fd0e784b lrc: 0/0,0 mode: --/PW res: [0x45f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527285:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527285:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736366108.527286:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.527286:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.527287:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008413ba80/0x98871c73fd0e7852 lrc: 3/0,1 mode: --/PW res: [0x45f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527291:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527291:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527292:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008413ba80/0x98871c73fd0e7852 lrc: 3/0,1 mode: PW/PW res: [0x45f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527295:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008413ba80/0x98871c73fd0e7852 lrc: 3/0,1 mode: PW/PW res: [0x45f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527299:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008413ba80/0x98871c73fd0e7852 lrc: 3/0,1 mode: PW/PW res: [0x45f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527302:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008413ba80/0x98871c73fd0e7852 lrc: 2/0,0 mode: PW/PW res: [0x45f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527311:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.527315:0:14340:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.527316:0:14340:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008413ba80/0x98871c73fd0e7852 lrc: 2/0,0 mode: PW/PW res: [0x45f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527320:0:14340:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008413ba80 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.527321:0:14340:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008413ba80/0x98871c73fd0e7852 lrc: 2/0,0 mode: PW/PW res: [0x45f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527329:0:14340:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008413ba80/0x98871c73fd0e7852 lrc: 3/0,0 mode: PW/PW res: [0x45f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527334:0:14340:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008413ba80/0x98871c73fd0e7852 lrc: 1/0,0 mode: --/PW res: [0x45f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527337:0:14340:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008413ba80/0x98871c73fd0e7852 lrc: 0/0,0 mode: --/PW res: [0x45f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736366108.527342:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.527343:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527343:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.527344:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084138900/0x98871c73fd0e7859 lrc: 3/0,1 mode: --/PW res: [0x45f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527344:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.527347:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527348:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527349:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084138900/0x98871c73fd0e7859 lrc: 3/0,1 mode: PW/PW res: [0x45f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527352:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084138900/0x98871c73fd0e7859 lrc: 3/0,1 mode: PW/PW res: [0x45f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527355:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084138900/0x98871c73fd0e7859 lrc: 3/0,1 mode: PW/PW res: [0x45f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527358:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880084138900/0x98871c73fd0e7859 lrc: 2/0,0 mode: PW/PW res: [0x45f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527362:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.527367:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.527368:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880084138900/0x98871c73fd0e7859 lrc: 2/0,0 mode: PW/PW res: [0x45f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527371:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880084138900 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.527372:0:8052:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880084138900/0x98871c73fd0e7859 lrc: 2/0,0 mode: PW/PW res: [0x45f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527375:0:8052:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880084138900/0x98871c73fd0e7859 lrc: 3/0,0 mode: PW/PW res: [0x45f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527379:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880084138900/0x98871c73fd0e7859 lrc: 1/0,0 mode: --/PW res: [0x45f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527382:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084138900/0x98871c73fd0e7859 lrc: 0/0,0 mode: --/PW res: [0x45f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736366108.527388:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.527390:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008413bcc0/0x98871c73fd0e7860 lrc: 3/0,1 mode: --/PW res: [0x45f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527393:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736366108.527393:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527393:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.527394:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736366108.527394:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.527395:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008413bcc0/0x98871c73fd0e7860 lrc: 3/0,1 mode: PW/PW res: [0x45f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527405:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008413bcc0/0x98871c73fd0e7860 lrc: 3/0,1 mode: PW/PW res: [0x45f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527408:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008413bcc0/0x98871c73fd0e7860 lrc: 3/0,1 mode: PW/PW res: [0x45f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527411:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008413bcc0/0x98871c73fd0e7860 lrc: 2/0,0 mode: PW/PW res: [0x45f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527416:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.527420:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.527422:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008413bcc0/0x98871c73fd0e7860 lrc: 2/0,0 mode: PW/PW res: [0x45f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527426:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008413bcc0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.527427:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008413bcc0/0x98871c73fd0e7860 lrc: 2/0,0 mode: PW/PW res: [0x45f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527430:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008413bcc0/0x98871c73fd0e7860 lrc: 3/0,0 mode: PW/PW res: [0x45f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527434:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008413bcc0/0x98871c73fd0e7860 lrc: 1/0,0 mode: --/PW res: [0x45f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527437:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008413bcc0/0x98871c73fd0e7860 lrc: 0/0,0 mode: --/PW res: [0x45f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527443:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527443:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527444:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736366108.527448:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.527449:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800841386c0/0x98871c73fd0e7867 lrc: 3/0,1 mode: --/PW res: [0x45f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527453:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527454:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527454:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800841386c0/0x98871c73fd0e7867 lrc: 3/0,1 mode: PW/PW res: [0x45f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527458:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800841386c0/0x98871c73fd0e7867 lrc: 3/0,1 mode: PW/PW res: [0x45f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527461:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800841386c0/0x98871c73fd0e7867 lrc: 3/0,1 mode: PW/PW res: [0x45f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527464:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800841386c0/0x98871c73fd0e7867 lrc: 2/0,0 mode: PW/PW res: [0x45f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527480:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736366108.527493:0:10475:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736366108.527495:0:10475:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800841386c0/0x98871c73fd0e7867 lrc: 2/0,0 mode: PW/PW res: [0x45f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527499:0:10475:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800841386c0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:3.0:1736366108.527500:0:10475:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800841386c0/0x98871c73fd0e7867 lrc: 2/0,0 mode: PW/PW res: [0x45f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527503:0:10475:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800841386c0/0x98871c73fd0e7867 lrc: 3/0,0 mode: PW/PW res: [0x45f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527509:0:10475:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800841386c0/0x98871c73fd0e7867 lrc: 1/0,0 mode: --/PW res: [0x45f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527512:0:10475:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800841386c0/0x98871c73fd0e7867 lrc: 0/0,0 mode: --/PW res: [0x45f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736366108.527514:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.527516:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084139200/0x98871c73fd0e786e lrc: 3/0,1 mode: --/PW res: [0x45f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527519:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366108.527519:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.527520:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527520:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1736366108.527520:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.527521:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084139200/0x98871c73fd0e786e lrc: 3/0,1 mode: PW/PW res: [0x45f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527525:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084139200/0x98871c73fd0e786e lrc: 3/0,1 mode: PW/PW res: [0x45f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527528:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084139200/0x98871c73fd0e786e lrc: 3/0,1 mode: PW/PW res: [0x45f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527531:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880084139200/0x98871c73fd0e786e lrc: 2/0,0 mode: PW/PW res: [0x45f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527536:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.527540:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.527542:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880084139200/0x98871c73fd0e786e lrc: 2/0,0 mode: PW/PW res: [0x45f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527557:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880084139200 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.527560:0:6822:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880084139200/0x98871c73fd0e786e lrc: 2/0,0 mode: PW/PW res: [0x45f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527564:0:6822:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880084139200/0x98871c73fd0e786e lrc: 3/0,0 mode: PW/PW res: [0x45f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527569:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880084139200/0x98871c73fd0e786e lrc: 1/0,0 mode: --/PW res: [0x45f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736366108.527572:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1736366108.527572:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084139200/0x98871c73fd0e786e lrc: 0/0,0 mode: --/PW res: [0x45f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527574:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084138000/0x98871c73fd0e7875 lrc: 3/0,1 mode: --/PW res: [0x45ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527577:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527578:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527578:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084138000/0x98871c73fd0e7875 lrc: 3/0,1 mode: PW/PW res: [0x45ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527579:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527580:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527580:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.527588:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084138000/0x98871c73fd0e7875 lrc: 3/0,1 mode: PW/PW res: [0x45ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527591:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084138000/0x98871c73fd0e7875 lrc: 3/0,1 mode: PW/PW res: [0x45ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527594:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880084138000/0x98871c73fd0e7875 lrc: 2/0,0 mode: PW/PW res: [0x45ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527599:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.527603:0:14340:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.527604:0:14340:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880084138000/0x98871c73fd0e7875 lrc: 2/0,0 mode: PW/PW res: [0x45ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527607:0:14340:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880084138000 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.527608:0:14340:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880084138000/0x98871c73fd0e7875 lrc: 2/0,0 mode: PW/PW res: [0x45ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527611:0:14340:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880084138000/0x98871c73fd0e7875 lrc: 3/0,0 mode: PW/PW res: [0x45ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527615:0:14340:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880084138000/0x98871c73fd0e7875 lrc: 1/0,0 mode: --/PW res: [0x45ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527622:0:14340:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084138000/0x98871c73fd0e7875 lrc: 0/0,0 mode: --/PW res: [0x45ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527629:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527629:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527630:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366108.527633:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:16284:x1820703013013248:12345-0@lo:5:osp-pre-1-0.0 Request processed in 719us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366108.527637:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94688 00000100:00100000:3.0:1736366108.527642:0:16284:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800869c7200 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16284:1820703013013248:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1736366108.527651:0:16284:0:(osp_precreate.c:722:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x100010000:0x43a1:0x0]-[0x100010000:0x43c1:0x0] 00002000:00010000:0.0:1736366108.527680:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.527682:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008413ad00/0x98871c73fd0e787c lrc: 3/0,1 mode: --/PW res: [0x45ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527685:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527686:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527686:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008413ad00/0x98871c73fd0e787c lrc: 3/0,1 mode: PW/PW res: [0x45ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527690:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008413ad00/0x98871c73fd0e787c lrc: 3/0,1 mode: PW/PW res: [0x45ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527693:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008413ad00/0x98871c73fd0e787c lrc: 3/0,1 mode: PW/PW res: [0x45ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527696:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008413ad00/0x98871c73fd0e787c lrc: 2/0,0 mode: PW/PW res: [0x45ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527707:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.527712:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.527713:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008413ad00/0x98871c73fd0e787c lrc: 2/0,0 mode: PW/PW res: [0x45ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527716:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008413ad00 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.527717:0:8052:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008413ad00/0x98871c73fd0e787c lrc: 2/0,0 mode: PW/PW res: [0x45ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527720:0:8052:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008413ad00/0x98871c73fd0e787c lrc: 3/0,0 mode: PW/PW res: [0x45ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527725:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008413ad00/0x98871c73fd0e787c lrc: 1/0,0 mode: --/PW res: [0x45ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527727:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008413ad00/0x98871c73fd0e787c lrc: 0/0,0 mode: --/PW res: [0x45ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527733:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527733:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527734:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736366108.527739:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.527741:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084138fc0/0x98871c73fd0e7883 lrc: 3/0,1 mode: --/PW res: [0x45ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527744:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527745:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527746:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084138fc0/0x98871c73fd0e7883 lrc: 3/0,1 mode: PW/PW res: [0x45ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527749:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084138fc0/0x98871c73fd0e7883 lrc: 3/0,1 mode: PW/PW res: [0x45ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527752:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084138fc0/0x98871c73fd0e7883 lrc: 3/0,1 mode: PW/PW res: [0x45ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527756:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880084138fc0/0x98871c73fd0e7883 lrc: 2/0,0 mode: PW/PW res: [0x45ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527760:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.527764:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.527768:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880084138fc0/0x98871c73fd0e7883 lrc: 2/0,0 mode: PW/PW res: [0x45ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527771:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880084138fc0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.527772:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880084138fc0/0x98871c73fd0e7883 lrc: 2/0,0 mode: PW/PW res: [0x45ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527785:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880084138fc0/0x98871c73fd0e7883 lrc: 3/0,0 mode: PW/PW res: [0x45ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527790:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880084138fc0/0x98871c73fd0e7883 lrc: 1/0,0 mode: --/PW res: [0x45ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527794:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084138fc0/0x98871c73fd0e7883 lrc: 0/0,0 mode: --/PW res: [0x45ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527800:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527800:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527801:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1736366108.527806:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1736366108.527808:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084138240/0x98871c73fd0e788a lrc: 3/0,1 mode: --/PW res: [0x45ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527812:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527812:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527813:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084138240/0x98871c73fd0e788a lrc: 3/0,1 mode: PW/PW res: [0x45ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527823:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084138240/0x98871c73fd0e788a lrc: 3/0,1 mode: PW/PW res: [0x45ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527827:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084138240/0x98871c73fd0e788a lrc: 3/0,1 mode: PW/PW res: [0x45ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527830:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880084138240/0x98871c73fd0e788a lrc: 2/0,0 mode: PW/PW res: [0x45ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527835:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1736366108.527841:0:10475:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1736366108.527843:0:10475:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880084138240/0x98871c73fd0e788a lrc: 2/0,0 mode: PW/PW res: [0x45ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527847:0:10475:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880084138240 already unused, calling callback (ffffffffa0811190) 00010000:00010000:3.0:1736366108.527848:0:10475:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880084138240/0x98871c73fd0e788a lrc: 2/0,0 mode: PW/PW res: [0x45ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527852:0:10475:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880084138240/0x98871c73fd0e788a lrc: 3/0,0 mode: PW/PW res: [0x45ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527857:0:10475:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880084138240/0x98871c73fd0e788a lrc: 1/0,0 mode: --/PW res: [0x45ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527860:0:10475:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084138240/0x98871c73fd0e788a lrc: 0/0,0 mode: --/PW res: [0x45ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1736366108.527868:0:29930:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x45eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1736366108.527868:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366108.527869:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.527870:0:29930:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008413b840/0x98871c73fd0e7891 lrc: 3/0,1 mode: --/PW res: [0x45eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366108.527870:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366108.527873:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527874:0:29930:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366108.527875:0:29930:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008413b840/0x98871c73fd0e7891 lrc: 3/0,1 mode: PW/PW res: [0x45eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527878:0:29930:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008413b840/0x98871c73fd0e7891 lrc: 3/0,1 mode: PW/PW res: [0x45eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527882:0:29930:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008413b840/0x98871c73fd0e7891 lrc: 3/0,1 mode: PW/PW res: [0x45eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527885:0:29930:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008413b840/0x98871c73fd0e7891 lrc: 2/0,0 mode: PW/PW res: [0x45eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366108.527895:0:29930:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366108.527899:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366108.527900:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008413b840/0x98871c73fd0e7891 lrc: 2/0,0 mode: PW/PW res: [0x45eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527904:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008413b840 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366108.527905:0:6822:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008413b840/0x98871c73fd0e7891 lrc: 2/0,0 mode: PW/PW res: [0x45eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527908:0:6822:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008413b840/0x98871c73fd0e7891 lrc: 3/0,0 mode: PW/PW res: [0x45eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527918:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008413b840/0x98871c73fd0e7891 lrc: 1/0,0 mode: --/PW res: [0x45eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1736366108.527920:0:29930:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x0:17898 00010000:00010000:1.0:1736366108.527921:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008413b840/0x98871c73fd0e7891 lrc: 0/0,0 mode: --/PW res: [0x45eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366108.527927:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527928:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366108.527929:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366108.527939:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:16282:x1820703013013056:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4649us (4704us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366108.527943:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94687 00000100:00100000:3.0:1736366108.527947:0:16282:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800869c63c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16282:1820703013013056:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1736366108.527951:0:16282:0:(osp_precreate.c:953:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x4609:0x0] from OST, last_created [0x100000000:0x4609:0x0]last_used is [0x100000000:0x45ea:0x0] 00000100:00100000:0.0:1736366108.527974:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3326:1820703013013312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1736366108.527981:0:16282:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16282:1820703013013376:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1736366108.527989:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366108.527998:0:16282:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366108.528002:0:9256:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013312 00000100:00100000:3.0:1736366108.528006:0:16282:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012a343cc0 going to sleep for 20 seconds 00000100:00100000:0.0:1736366108.528013:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013376 00000100:00100000:1.0:1736366108.528015:0:9256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5827 00000100:00100000:1.0:1736366108.528018:0:9256:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3326:x1820703013013312:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:1.0:1736366108.528020:0:9256:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736366108.528022:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94689 00000100:00100000:0.0:1736366108.528024:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fb09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+6:16282:x1820703013013376:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:0.0:1736366108.528027:0:29930:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1736366108.528029:0:9256:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8658560 pending 0 free 3906641920 avail 3675119616 00002000:00080000:0.0:1736366108.528036:0:29930:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x0 at 17930 00000100:00100000:1.0:1736366108.528054:0:9256:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3326:x1820703013013312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366108.528057:0:9256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5827 00000100:00100000:2.0:1736366108.528069:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3326:1820703013013312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1736366108.528670:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fb09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:16282:x1820703013013376:12345-0@lo:5:osp-pre-0-0.0 Request processed in 645us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366108.528674:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94689 00000100:00100000:3.0:1736366108.528733:0:16282:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16282:1820703013013376:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1736366108.528740:0:16282:0:(osp_precreate.c:722:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x100000000:0x4609:0x0]-[0x100000000:0x4629:0x0] 00000100:00100000:2.0:1736366108.719303:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d208980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013013632:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366108.719303:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013013440:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366108.719322:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800869c76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3324:1820703013013504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1736366108.719328:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2084c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3325:1820703013013568:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366108.719360:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366108.719361:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366108.719361:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366108.719375:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d209300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3323:1820703013013696:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366108.719381:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013504 00000100:00100000:1.0:1736366108.719382:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d209c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013013760:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366108.719388:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366108.719392:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013013888:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366108.719404:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77042 00000100:00100000:0.0:1736366108.719407:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3324:x1820703013013504:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1736366108.719411:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3323:1820703013013952:0@lo:400:kworker/u8:0.0 00000020:02000000:0.0:1736366108.719412:0:9264:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1736366108.719415:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013440 00000100:00100000:2.0:1736366108.719417:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366108.719422:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366108.719429:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000004:00000024:0.0:1736366108.719430:0:9264:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445543936 avail 1316081664 00000100:00100000:1.0:1736366108.719431:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+23:3323:x1820703013013440:12345-0@lo:400:kworker/u8:0.0 00000020:02000000:1.0:1736366108.719434:0:16269:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1736366108.719436:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013888 00000100:00100000:3.0:1736366108.719439:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013632 00000100:00100000:2.0:1736366108.719450:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7180 00000100:00100000:3.0:1736366108.719452:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013696 00000100:00100000:0.0:1736366108.719453:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3324:x1820703013013504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366108.719453:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013013888:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366108.719454:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+23:3323:x1820703013013440:12345-0@lo:400:kworker/u8:0.0 Request processed in 22us (95us total) trans 0 rc 0/0 00000020:02000000:2.0:1736366108.719456:0:29930:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736366108.719457:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77042 00000100:00100000:3.0:1736366108.719466:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013952 00000100:00100000:1.0:1736366108.719467:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1736366108.719474:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1736366108.719476:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013013632:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366108.719477:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000020:02000000:3.0:1736366108.719479:0:25141:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1736366108.719484:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366108.719485:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1820703013013696:12345-0@lo:400:kworker/u8:0.0 00000020:02000000:0.0:1736366108.719488:0:25142:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1736366108.719488:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:1.0:1736366108.719491:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3324:1820703013014016:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366108.719492:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3323:x1820703013013952:12345-0@lo:400:kworker/u8:0.0 00000020:02000000:2.0:1736366108.719494:0:26348:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1736366108.719502:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013013632:12345-0@lo:400:kworker/u8:0.0 Request processed in 25us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366108.719506:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1820703013013696:12345-0@lo:400:kworker/u8:0.0 Request processed in 20us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366108.719506:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:1.0:1736366108.719507:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366108.719510:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1736366108.719513:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013760 00000100:00100000:2.0:1736366108.719516:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3323:x1820703013013952:12345-0@lo:400:kworker/u8:0.0 Request processed in 24us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366108.719519:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1736366108.719521:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1736366108.719523:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013013760:12345-0@lo:400:kworker/u8:0.0 00000020:02000000:3.0:1736366108.719525:0:25141:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736366108.719529:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366108.719529:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800869c76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3324:1820703013013504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1736366108.719538:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013013824:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366108.719538:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d208980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013013632:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366108.719538:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013013760:12345-0@lo:400:kworker/u8:0.0 Request processed in 14us (53us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366108.719540:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d209c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013013760:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366108.719541:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1736366108.719545:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013568 00000100:00100000:0.0:1736366108.719549:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366108.719550:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014016 00000100:00100000:3.0:1736366108.719551:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1736366108.719556:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3325:1820703013014080:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366108.719558:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77043 00000100:00100000:3.0:1736366108.719558:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1820703013013568:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366108.719559:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013013888:12345-0@lo:400:kworker/u8:0.0 Request processed in 105us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366108.719560:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3324:x1820703013014016:12345-0@lo:400:kworker/u8:0.0 00000020:02000000:3.0:1736366108.719560:0:25141:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:1.0:1736366108.719562:0:9264:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1736366108.719562:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7180 00000100:00100000:0.0:1736366108.719565:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366108.719574:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013013888:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366108.719576:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1820703013013568:12345-0@lo:400:kworker/u8:0.0 Request processed in 18us (47us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366108.719577:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014080 00000100:00100000:1.0:1736366108.719579:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3324:x1820703013014016:12345-0@lo:400:kworker/u8:0.0 Request processed in 19us (72us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366108.719580:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:1.0:1736366108.719582:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77043 00000100:00100000:2.0:1736366108.719582:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013013824 00000100:00100000:0.0:1736366108.719584:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1736366108.719586:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1820703013014080:12345-0@lo:400:kworker/u8:0.0 00000020:02000000:0.0:1736366108.719588:0:16831:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1736366108.719592:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3324:1820703013014016:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366108.719594:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7181 00000100:00100000:2.0:1736366108.719596:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013013824:12345-0@lo:400:kworker/u8:0.0 00000020:02000000:2.0:1736366108.719598:0:24517:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736366108.719600:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1820703013014080:12345-0@lo:400:kworker/u8:0.0 Request processed in 13us (35us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366108.719602:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3323:1820703013013952:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366108.719603:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1736366108.719606:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013013440:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366108.719610:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013013824:12345-0@lo:400:kworker/u8:0.0 Request processed in 14us (61us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366108.719611:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d209300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3323:1820703013013696:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366108.719613:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7181 00000100:00100000:0.0:1736366108.719622:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2084c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3325:1820703013013568:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366108.719627:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013013824:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366108.719630:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3325:1820703013014080:0@lo:400:kworker/u8:0.0 00010000:00010000:1.0:1736366108.725265:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1736366109.467254:0:24906:0:(ldlm_lib.c:3016:target_queue_recovery_request()) @@@ queue final req req@ffff88012d20aac0 x1820703013012992/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1736366118 ref 2 fl Interpret:/c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' 00000100:00100000:2.0:1736366109.467345:0:24906:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3322:x1820703013012992:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 999224us (999264us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366109.467355:0:24906:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77041 00000100:00080000:0.0:1736366109.467397:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1736366109.467403:0:3322:0:(client.c:2972:ptlrpc_resend_req()) @@@ going to resend req@ffff88012d20b440 x1820703013012992/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1736366138 ref 1 fl Interpret:RQU/c0/0 rc 0/0 job:'ptlrpcd_rcv.0' 00000100:00080000:0.0:1736366109.467408:0:3322:0:(client.c:2981:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff88012d20b440 x1820703013012992/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1736366138 ref 1 fl Interpret:RQU/c0/0 rc 0/0 job:'ptlrpcd_rcv.0' 00000100:00080000:0.0:1736366109.467424:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1736366109.467440:0:3322:0:(import.c:1644:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to (at 0@lo) 00000100:00100000:1.0:1736366109.467518:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736366109.467529:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013014144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1736366109.467556:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366109.467575:0:24906:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014144 00000100:00100000:2.0:1736366109.467605:0:24906:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77044 00000100:00100000:2.0:1736366109.467609:0:24906:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013014144:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1736366109.467620:0:24906:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1736366109.467641:0:24906:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445052416 avail 1315590144 00000100:00100000:2.0:1736366109.467671:0:24906:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013014144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366109.467676:0:24906:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77044 00000100:00100000:1.0:1736366109.467680:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013014144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1736366109.471494:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013012992:0@lo:400:ptlrpcd_rcv.0 00010000:00010000:1.0:1736366109.727324:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366110.729381:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366111.471353:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800869c4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013014208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366111.471405:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366111.471450:0:9256:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014208 00000100:00100000:1.0:1736366111.471490:0:9256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5828 00000100:00100000:1.0:1736366111.471495:0:9256:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013014208:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:1.0:1736366111.471512:0:9256:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1736366111.471535:0:9256:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8657664 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736366111.471581:0:9256:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013014208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366111.471588:0:9256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5828 00000100:00100000:3.0:1736366111.471599:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800869c4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013014208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366111.487271:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736366111.487280:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013014272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366111.487302:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366111.487334:0:9256:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014272 00000100:00100000:1.0:1736366111.487358:0:9256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5829 00000100:00100000:1.0:1736366111.487360:0:9256:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013014272:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:1.0:1736366111.487363:0:9256:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1736366111.487375:0:9256:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:1.0:1736366111.487403:0:9256:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013014272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366111.487407:0:9256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5829 00000100:00100000:2.0:1736366111.487424:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013014272:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1736366111.731351:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366112.733337:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366113.503611:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366113.503638:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366113.503653:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366113.503671:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041010176 00000100:00100000:0.0:1736366113.503680:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366113.503713:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041010304 00000100:00100000:1.0:1736366113.503722:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 159 00000100:00100000:2.0:1736366113.503724:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041010240 00000100:00100000:1.0:1736366113.503727:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1876:x1820703041010176:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366113.503733:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 642 00000020:02000000:1.0:1736366113.503733:0:16273:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736366113.503736:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1877:x1820703041010304:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000020:02000000:0.0:1736366113.503739:0:25142:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1736366113.503747:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 829 00000100:00100000:3.0:1736366113.503747:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041010368 00000100:00100000:2.0:1736366113.503750:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041010240:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000020:02000000:2.0:1736366113.503753:0:26348:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:2.0:1736366113.503766:0:26348:0:(ldlm_lib.c:1370:target_handle_connect()) lustre-MDT0000: connection from cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b@192.168.201.2@tcp t18446612137383356512 exp (null) cur 8461 last 0 00000100:00100000:3.0:1736366113.503769:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 7182 00000100:00100000:0.0:1736366113.503772:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1877:x1820703041010304:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 36us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366113.503772:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1876:x1820703041010368:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366113.503775:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1876:x1820703041010176:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 48us (168us total) trans 0 rc 0/0 00000020:02000000:3.0:1736366113.503775:0:9254:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736366113.503777:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 642 00000100:00100000:1.0:1736366113.503781:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 159 00000100:00100000:3.0:1736366113.503796:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1876:x1820703041010368:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 23us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366113.503799:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 7182 00000020:00000080:2.0:1736366113.503800:0:26348:0:(genops.c:1359:class_connect()) connect: client cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b, cookie 0x98871c73fd0e7898 00000004:00100000:2.0:1736366113.503815:0:26348:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1736366113.503819:0:26348:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 126, last_transno is 541165879296 00000020:01000000:2.0:1736366113.505349:0:26348:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash ffff88012cfe79c0 00000100:00080000:2.0:1736366113.505372:0:26348:0:(import.c:86:import_set_state_nolock()) ffff8800739e6000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from RECOVER to FULL 00000100:00100000:2.0:1736366113.505405:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1873:x1820703041010240:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 1654us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366113.505410:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 829 00000100:00100000:2.0:1736366113.535292:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3326:1820703013014400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1736366113.535322:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800869c76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3325:1820703013014336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1736366113.535329:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366113.535353:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366113.535389:0:9257:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014400 00000100:00100000:3.0:1736366113.535416:0:9257:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014336 00000100:00100000:0.0:1736366113.535421:0:9256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5830 00000100:00100000:0.0:1736366113.535425:0:9256:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095174740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1820703013014400:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:0.0:1736366113.535429:0:9256:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1736366113.535431:0:9257:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5831 00000100:00100000:3.0:1736366113.535434:0:9257:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1820703013014336:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:3.0:1736366113.535437:0:9257:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1736366113.535446:0:9256:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00002000:00000024:3.0:1736366113.535455:0:9257:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8657664 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736366113.535479:0:9257:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1820703013014336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366113.535483:0:9256:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095174740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1820703013014400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366113.535483:0:9257:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5831 00000100:00100000:0.0:1736366113.535487:0:9256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5830 00000100:00100000:1.0:1736366113.535496:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800869c76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3325:1820703013014336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1736366113.535505:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3326:1820703013014400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1736366113.727274:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3325:1820703013014592:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366113.727303:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013014656:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366113.727324:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2084c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013014464:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366113.727333:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366113.727338:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd78980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3324:1820703013014528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1736366113.727352:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366113.727368:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366113.727369:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3323:1820703013014720:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366113.727370:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d209300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013014848:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366113.727387:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366113.727388:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013014784:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366113.727389:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366113.727394:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013014976:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366113.727396:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3325:1820703013015104:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366113.727399:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014592 00000100:00100000:0.0:1736366113.727400:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366113.727408:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3324:1820703013015040:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366113.727409:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366113.727409:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366113.727419:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366113.727425:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014528 00000100:00100000:3.0:1736366113.727426:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014720 00000100:00100000:2.0:1736366113.727430:0:24906:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014848 00000100:00100000:3.0:1736366113.727432:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014784 00000100:00100000:3.0:1736366113.727437:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013015040 00000100:00100000:1.0:1736366113.727438:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013015104 00000100:00100000:0.0:1736366113.727441:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:2.0:1736366113.727442:0:24906:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77045 00000100:00100000:2.0:1736366113.727445:0:24906:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d208980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3324:x1820703013014528:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1736366113.727446:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1820703013014592:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366113.727447:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77046 00000100:00100000:3.0:1736366113.727447:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000020:02000000:0.0:1736366113.727449:0:25656:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1736366113.727449:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd78e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013014848:12345-0@lo:400:kworker/u8:0.0 00000020:02000000:2.0:1736366113.727449:0:24906:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1736366113.727450:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a12600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1820703013014720:12345-0@lo:400:kworker/u8:0.0 00000020:02000000:1.0:1736366113.727452:0:24903:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:3.0:1736366113.727453:0:26348:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1736366113.727469:0:24906:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445543936 avail 1316081664 00000100:00100000:1.0:1736366113.727475:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd78e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013014848:12345-0@lo:400:kworker/u8:0.0 Request processed in 25us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366113.727478:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77046 00000100:00100000:0.0:1736366113.727481:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1820703013014592:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366113.727484:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a12600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1820703013014720:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366113.727485:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1736366113.727488:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:1.0:1736366113.727489:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77047 00000100:00100000:1.0:1736366113.727491:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3325:x1820703013015104:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366113.727492:0:24906:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d208980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3324:x1820703013014528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (124us total) trans 0 rc 0/0 00000020:02000000:1.0:1736366113.727493:0:24903:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1736366113.727495:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1736366113.727496:0:24906:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77045 00000100:00100000:0.0:1736366113.727497:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1736366113.727497:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013014784:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366113.727499:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3324:x1820703013015040:12345-0@lo:400:kworker/u8:0.0 00000020:02000000:3.0:1736366113.727499:0:26348:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:0.0:1736366113.727501:0:25656:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1736366113.727502:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3325:x1820703013015104:12345-0@lo:400:kworker/u8:0.0 Request processed in 11us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366113.727505:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77047 00000100:00100000:3.0:1736366113.727512:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013014784:12345-0@lo:400:kworker/u8:0.0 Request processed in 15us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366113.727515:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3324:x1820703013015040:12345-0@lo:400:kworker/u8:0.0 Request processed in 15us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366113.727515:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3323:1820703013014720:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366113.727515:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:0.0:1736366113.727518:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:1.0:1736366113.727519:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014464 00000100:00100000:0.0:1736366113.727528:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366113.727528:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014976 00000100:00100000:1.0:1736366113.727529:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1736366113.727531:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+23:3323:x1820703013014464:12345-0@lo:400:kworker/u8:0.0 00000020:02000000:1.0:1736366113.727532:0:16269:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736366113.727534:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013014912:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366113.727535:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd78980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3324:1820703013014528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1736366113.727538:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7183 00000100:00100000:2.0:1736366113.727540:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013014784:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366113.727540:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a150c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013014976:12345-0@lo:400:kworker/u8:0.0 00000020:02000000:3.0:1736366113.727542:0:29930:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1736366113.727545:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+23:3323:x1820703013014464:12345-0@lo:400:kworker/u8:0.0 Request processed in 14us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366113.727546:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3324:1820703013015040:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366113.727547:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366113.727548:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1736366113.727553:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d209c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3326:1820703013015168:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366113.727555:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a150c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013014976:12345-0@lo:400:kworker/u8:0.0 Request processed in 14us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366113.727558:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7183 00000100:00100000:2.0:1736366113.727560:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014912 00000100:00100000:0.0:1736366113.727564:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366113.727567:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013014656 00000100:00100000:2.0:1736366113.727570:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7184 00000100:00100000:2.0:1736366113.727572:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a569300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013014912:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366113.727574:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d209300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013014848:0@lo:400:kworker/u8:0.0 00000020:02000000:2.0:1736366113.727574:0:24517:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736366113.727575:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013015168 00000100:00100000:1.0:1736366113.727579:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3325:1820703013015104:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366113.727583:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1736366113.727585:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3325:1820703013014592:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366113.727585:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009269cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013014656:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366113.727586:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000020:02000000:3.0:1736366113.727587:0:25140:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1736366113.727588:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1820703013015168:12345-0@lo:400:kworker/u8:0.0 00000020:02000000:0.0:1736366113.727590:0:25656:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1736366113.727591:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a569300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013014912:12345-0@lo:400:kworker/u8:0.0 Request processed in 18us (43us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366113.727599:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7184 00000100:00100000:3.0:1736366113.727600:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009269cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013014656:12345-0@lo:400:kworker/u8:0.0 Request processed in 15us (72us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366113.727603:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1736366113.727609:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1820703013015168:12345-0@lo:400:kworker/u8:0.0 Request processed in 20us (45us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366113.727612:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1736366113.727614:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2084c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013014464:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366113.727619:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013014976:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366113.727636:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013014656:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366113.727641:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013014912:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366113.727644:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d209c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3326:1820703013015168:0@lo:400:kworker/u8:0.0 00010000:00010000:1.0:1736366113.735289:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366114.479366:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013015232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1736366114.479417:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366114.479455:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013015232 00000100:00100000:1.0:1736366114.479486:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77048 00000100:00100000:1.0:1736366114.479490:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013015232:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:1.0:1736366114.479495:0:9264:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1736366114.479514:0:9264:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1315590144 00000100:00100000:1.0:1736366114.479548:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013015232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366114.479553:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77048 00000100:00100000:2.0:1736366114.479568:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013015232:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1736366114.737424:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366114.766374:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366114.766468:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041010432 00000100:00100000:2.0:1736366114.766528:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 830 00000100:00100000:2.0:1736366114.766536:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a5697c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:14540:x1820703041010432:12345-192.168.201.2@tcp:101:lfs.0 00000020:02000000:2.0:1736366114.766545:0:25656:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:2.0:1736366114.766561:0:25656:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1736366114.766581:0:25656:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbddd40/0x98871c73fd0e789f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50df2825ebe24a0d expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1736366114.767141:0:25656:0:(mdt_identity.c:116:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 513us 00010000:00010000:3.0:1736366114.770544:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008db6c000/0x98871c73fd0e78a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366114.770560:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008db6c000/0x98871c73fd0e78a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366114.770573:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008db6c000/0x98871c73fd0e78a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1736366114.773400:0:25656:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1736366114.773405:0:25656:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 185 stripe count 1 MDT count 8 00000004:00010000:0.0:1736366114.773432:0:25656:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008db6c000/0x98871c73fd0e78a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366114.773458:0:25656:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbddd40/0x98871c73fd0e789f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a0d expref: 8 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366114.773485:0:25656:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008db6c000/0x98871c73fd0e78a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a0d expref: 7 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366114.773493:0:25656:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88013522d500) 00010000:00010000:0.0:1736366114.773495:0:25656:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1736366114.773497:0:25656:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008db6c000, rc 0) 00000100:00100000:0.0:1736366114.773548:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a5697c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+7:14540:x1820703041010432:12345-192.168.201.2@tcp:101:lfs.0 Request processed in 7011us (7180us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366114.773556:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 830 00000100:00100000:0.0:1736366114.775778:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366114.775882:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041010496 00000100:00100000:2.0:1736366114.775922:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 831 00000100:00100000:2.0:1736366114.775927:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+7:14540:x1820703041010496:12345-192.168.201.2@tcp:41:lfs.0 00000020:02000000:2.0:1736366114.775932:0:25656:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1736366114.775949:0:25656:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1315590144 00000100:00100000:2.0:1736366114.776001:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+7:14540:x1820703041010496:12345-192.168.201.2@tcp:41:lfs.0 Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366114.776007:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 831 00000100:00100000:0.0:1736366114.777397:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366114.777508:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041010560 00000100:00100000:2.0:1736366114.777548:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 832 00000100:00100000:2.0:1736366114.777561:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:14540:x1820703041010560:12345-192.168.201.2@tcp:41:lfs.0 00000020:02000000:2.0:1736366114.777566:0:25656:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1736366114.777586:0:25656:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445543936 avail 1316081664 00000100:00100000:2.0:1736366114.777636:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:14540:x1820703041010560:12345-192.168.201.2@tcp:41:lfs.0 Request processed in 76us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366114.777643:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 832 00000100:00100000:0.0:1736366114.779267:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366114.779385:0:9256:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041010624 00000100:00100000:2.0:1736366114.779427:0:9256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 5832 00000100:00100000:2.0:1736366114.779432:0:9256:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:14540:x1820703041010624:12345-192.168.201.2@tcp:13:lfs.0 00000020:02000000:2.0:1736366114.779437:0:9256:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1736366114.779452:0:9256:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8657664 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366114.779499:0:9256:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:14540:x1820703041010624:12345-192.168.201.2@tcp:13:lfs.0 Request processed in 67us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366114.779506:0:9256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 5832 00000100:00100000:0.0:1736366114.780875:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366114.780986:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041010688 00000100:00100000:1.0:1736366114.781025:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 94690 00000100:00100000:1.0:1736366114.781031:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:1873:x1820703041010688:12345-192.168.201.2@tcp:8:lfs.0 00000020:02000000:1.0:1736366114.781035:0:9254:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:1.0:1736366114.781057:0:9254:0:(ldlm_lib.c:1370:target_handle_connect()) lustre-OST0001: connection from cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b@192.168.201.2@tcp t0 exp (null) cur 8462 last 0 00000020:00000080:1.0:1736366114.781081:0:9254:0:(genops.c:1359:class_connect()) connect: client cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b, cookie 0x98871c73fd0e78ad 00002000:00100000:1.0:1736366114.781089:0:9254:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b/ffff880086b65000 ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0600 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1736366114.781098:0:9254:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:01000000:1.0:1736366114.781151:0:9254:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash ffff880086942c00 00002000:00080000:1.0:1736366114.781159:0:9254:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1736366114.781223:0:9254:0:(import.c:86:import_set_state_nolock()) ffff880086b67000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1736366114.781267:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1873:x1820703041010688:12345-192.168.201.2@tcp:8:lfs.0 Request processed in 235us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366114.781282:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 94690 00000100:00100000:0.0:1736366114.782650:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366114.782761:0:9256:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041010752 00000100:00100000:2.0:1736366114.782799:0:9256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 5833 00000100:00100000:2.0:1736366114.782804:0:9256:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086935a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:14540:x1820703041010752:12345-192.168.201.2@tcp:13:lfs.0 00000020:02000000:2.0:1736366114.782809:0:9256:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1736366114.782821:0:9256:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366114.782866:0:9256:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086935a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:14540:x1820703041010752:12345-192.168.201.2@tcp:13:lfs.0 Request processed in 61us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366114.782873:0:9256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 5833 00000100:00100000:0.0:1736366114.788787:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366114.788856:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041010816 00000100:00100000:2.0:1736366114.788892:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 833 00000100:00100000:2.0:1736366114.788897:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+7:13913:x1820703041010816:12345-192.168.201.2@tcp:101:multiop.0 00000020:02000000:2.0:1736366114.788911:0:25656:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:2.0:1736366114.788919:0:25656:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1736366114.788928:0:25656:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbddd40/0x98871c73fd0e78b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50df2825ebe24a14 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.788966:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde400/0x98871c73fd0e78bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.788974:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde400/0x98871c73fd0e78bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.788981:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde400/0x98871c73fd0e78bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.788990:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdf840/0x98871c73fd0e78c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.788995:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdf840/0x98871c73fd0e78c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789000:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdf840/0x98871c73fd0e78c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789106:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde880/0x98871c73fd0e78c9 lrc: 3/1,0 mode: --/PR res: [0x20003d491:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789112:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde880/0x98871c73fd0e78c9 lrc: 3/1,0 mode: PR/PR res: [0x20003d491:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789117:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde880/0x98871c73fd0e78c9 lrc: 3/1,0 mode: PR/PR res: [0x20003d491:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1736366114.789148:0:25656:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20003d491:0x1:0x0]: returning size 0 00000004:00200000:2.0:1736366114.789151:0:25656:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1736366114.789194:0:25656:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde880/0x98871c73fd0e78c9 lrc: 3/1,0 mode: PR/PR res: [0x20003d491:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789202:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde880/0x98871c73fd0e78c9 lrc: 3/1,0 mode: PR/PR res: [0x20003d491:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789208:0:25656:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde400/0x98871c73fd0e78bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789213:0:25656:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde400/0x98871c73fd0e78bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789218:0:25656:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde400/0x98871c73fd0e78bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789222:0:25656:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbde400 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:2.0:1736366114.789225:0:25656:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde400/0x98871c73fd0e78bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789230:0:25656:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde400/0x98871c73fd0e78bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789238:0:25656:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88013522d500) 00010000:00010000:2.0:1736366114.789240:0:25656:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736366114.789242:0:25656:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde400/0x98871c73fd0e78bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789247:0:25656:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde400/0x98871c73fd0e78bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789272:0:25656:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdf840/0x98871c73fd0e78c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789277:0:25656:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdf840/0x98871c73fd0e78c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789282:0:25656:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdf840/0x98871c73fd0e78c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789286:0:25656:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdf840 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:2.0:1736366114.789287:0:25656:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdf840/0x98871c73fd0e78c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789291:0:25656:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdf840/0x98871c73fd0e78c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789297:0:25656:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d214928 (ffff88013522dc00) 00010000:00010000:2.0:1736366114.789298:0:25656:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736366114.789300:0:25656:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdf840/0x98871c73fd0e78c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789303:0:25656:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdf840/0x98871c73fd0e78c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789324:0:25656:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbddd40/0x98871c73fd0e78b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a14 expref: 9 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789331:0:25656:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde880/0x98871c73fd0e78c9 lrc: 3/0,0 mode: PR/PR res: [0x20003d491:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a14 expref: 8 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366114.789346:0:25656:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003d491:0x1:0x0].0x0 (ffff88013522d100) 00010000:00010000:2.0:1736366114.789347:0:25656:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1736366114.789348:0:25656:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008dbde880, rc 0) 00000100:00100000:2.0:1736366114.789376:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+8:13913:x1820703041010816:12345-192.168.201.2@tcp:101:multiop.0 Request processed in 478us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366114.789382:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 833 00000100:00100000:2.0:1736366115.481803:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366115.481829:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041010944 00000100:00100000:0.0:1736366115.481866:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 834 00000100:00100000:0.0:1736366115.481871:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a15f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+8:14663:x1820703041010944:12345-192.168.201.2@tcp:36:rm.0 00010000:00010000:0.0:1736366115.481909:0:25656:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1736366115.481930:0:25656:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbde880/0x98871c73fd0e78c9 lrc: 0/0,0 mode: --/PR res: [0x20003d491:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a14 expref: 8 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.481944:0:25656:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003d491:0x1:0x0].0x0 (ffff88013522d100) 00010000:00010000:0.0:1736366115.481954:0:25656:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008db6c000/0x98871c73fd0e78a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a0d expref: 7 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.481960:0:25656:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88013522d500) 00010000:00010000:0.0:1736366115.481964:0:25656:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1736366115.481983:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78d0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.481993:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482000:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482007:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880084138480/0x98871c73fd0e78d7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5d214928 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482012:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880084138480/0x98871c73fd0e78d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482022:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880084138480/0x98871c73fd0e78d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482084:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880084139d40/0x98871c73fd0e78de lrc: 3/0,1 mode: --/EX res: [0x20003d491:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482089:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880084139d40/0x98871c73fd0e78de lrc: 3/0,1 mode: EX/EX res: [0x20003d491:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482093:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880084139d40/0x98871c73fd0e78de lrc: 3/0,1 mode: EX/EX res: [0x20003d491:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1736366115.482299:0:25656:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x1f8:0x0].2, 64 off8320 00000004:00080000:0.0:1736366115.482304:0:25656:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8463579140204ns, next at 8464579138915ns, rc = 0 00010000:00010000:0.0:1736366115.482338:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008413aac0/0x98871c73fd0e78e5 lrc: 3/0,1 mode: --/PW res: [0x20003d491:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482345:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008413aac0/0x98871c73fd0e78e5 lrc: 3/0,1 mode: PW/PW res: [0x20003d491:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134809828112 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482351:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008413aac0/0x98871c73fd0e78e5 lrc: 3/0,1 mode: PW/PW res: [0x20003d491:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134809828112 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482356:0:25656:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008413aac0/0x98871c73fd0e78e5 lrc: 4/0,1 mode: PW/PW res: [0x20003d491:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134809828112 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482361:0:25656:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008413aac0/0x98871c73fd0e78e5 lrc: 4/0,1 mode: PW/PW res: [0x20003d491:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134809828112 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482374:0:25656:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008413aac0/0x98871c73fd0e78e5 lrc: 3/0,0 mode: PW/PW res: [0x20003d491:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134809828112 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482394:0:25656:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1736366115.482415:0:25656:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff880099a15f00 reply state ffff88009a64d000 transno 541165879297 ns: mdt-lustre-MDT0000_UUID lock: ffff880084139d40/0x98871c73fd0e78de lrc: 3/0,1 mode: EX/EX res: [0x20003d491:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366115.482419:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366115.482426:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008413aac0/0x98871c73fd0e78e5 lrc: 2/0,0 mode: PW/PW res: [0x20003d491:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134809828112 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366115.482438:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008413aac0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366115.482442:0:6823:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008413aac0/0x98871c73fd0e78e5 lrc: 2/0,0 mode: PW/PW res: [0x20003d491:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134809828112 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366115.482449:0:6823:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008413aac0/0x98871c73fd0e78e5 lrc: 3/0,0 mode: PW/PW res: [0x20003d491:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134809828112 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366115.482460:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003d491:0x1:0x0].0x0 (ffff8800aa4b4400) 00010000:00010000:1.0:1736366115.482462:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1736366115.482464:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008413aac0/0x98871c73fd0e78e5 lrc: 1/0,0 mode: --/PW res: [0x20003d491:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134809828112 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366115.482468:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008413aac0/0x98871c73fd0e78e5 lrc: 0/0,0 mode: --/PW res: [0x20003d491:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134809828112 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366115.482478:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366115.482479:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366115.482481:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366115.482492:0:25656:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482497:0:25656:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78d0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482501:0:25656:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482505:0:25656:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800841398c0 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:0.0:1736366115.482507:0:25656:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482511:0:25656:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78d0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482517:0:25656:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800aa4b4d00) 00010000:00010000:0.0:1736366115.482519:0:25656:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1736366115.482520:0:25656:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78d0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366115.482524:0:25656:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78d0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1736366115.482537:0:25656:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff880099a15f00 reply state ffff88009a64d000 transno 541165879297 ns: mdt-lustre-MDT0000_UUID lock: ffff880084138480/0x98871c73fd0e78d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1736366115.482601:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a15f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+8:14663:x1820703041010944:12345-192.168.201.2@tcp:36:rm.0 Request processed in 729us (801us total) trans 541165879297 rc 0/0 00000100:00100000:0.0:1736366115.482608:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 834 00010000:00010000:1.0:1736366115.483380:0:3310:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880084138480/0x98871c73fd0e78d7 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366115.483390:0:3310:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d214928 (ffff8800aa4b4600) 00010000:00010000:1.0:1736366115.483392:0:3310:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1736366115.483401:0:3310:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880084139d40/0x98871c73fd0e78de lrc: 3/0,1 mode: COS/COS res: [0x20003d491:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366115.483407:0:3310:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003d491:0x1:0x0].0x0 (ffff8800aa4b4400) 00010000:00010000:1.0:1736366115.483408:0:3310:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1736366115.739254:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366116.479333:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736366116.479352:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013015296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366116.479410:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366116.479461:0:9256:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013015296 00000100:00100000:0.0:1736366116.479507:0:9256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5834 00000100:00100000:0.0:1736366116.479512:0:9256:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d209c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013015296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366116.479537:0:9256:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8657664 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366116.479581:0:9256:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d209c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013015296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366116.479586:0:9256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5834 00000100:00100000:2.0:1736366116.479615:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013015296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366116.495264:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366116.495273:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013015360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366116.495296:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366116.495312:0:9256:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013015360 00000100:00100000:1.0:1736366116.495333:0:9256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5835 00000100:00100000:1.0:1736366116.495335:0:9256:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013015360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736366116.495348:0:9256:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3923435520 avail 3691913216 00000100:00100000:1.0:1736366116.495390:0:9256:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013015360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366116.495394:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013015360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366116.495394:0:9256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5835 00010000:00010000:1.0:1736366116.741370:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1736366116.957510:0:17297:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1736366116.957513:0:17297:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 14:55:17 (1736366117) 00000001:00080000:0.0:1736366117.188995:0:16265:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 541165879297 is committed 00000004:00080000:0.0:1736366117.189003:0:16265:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1736366117.189017:0:3309:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: ffff880084138480/0x98871c73fd0e78d7 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000001:00100000:0.0:1736366117.189027:0:16265:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 00010000:00010000:2.0:1736366117.189028:0:3309:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880084138480/0x98871c73fd0e78d7 lrc: 2/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.189032:0:3309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880084138480/0x98871c73fd0e78d7 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.189036:0:3309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880084138480 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:2.0:1736366117.189038:0:3309:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880084138480/0x98871c73fd0e78d7 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.189042:0:3309:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880084138480/0x98871c73fd0e78d7 lrc: 4/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.189058:0:3309:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d214928 (ffff8800aa4b4600) 00010000:00010000:2.0:1736366117.189059:0:3309:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736366117.189061:0:3309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880084138480/0x98871c73fd0e78d7 lrc: 2/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.189064:0:3309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880084138480/0x98871c73fd0e78d7 lrc: 0/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x5d214928 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.189073:0:3309:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: ffff880084139d40/0x98871c73fd0e78de lrc: 3/0,1 mode: COS/COS res: [0x20003d491:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.189076:0:3309:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880084139d40/0x98871c73fd0e78de lrc: 2/0,0 mode: COS/COS res: [0x20003d491:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.189079:0:3309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880084139d40/0x98871c73fd0e78de lrc: 3/0,0 mode: COS/COS res: [0x20003d491:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000001:00100000:3.0:1736366117.189081:0:21815:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 00010000:00010000:2.0:1736366117.189082:0:3309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880084139d40 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:2.0:1736366117.189083:0:3309:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880084139d40/0x98871c73fd0e78de lrc: 3/0,0 mode: COS/COS res: [0x20003d491:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.189086:0:3309:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880084139d40/0x98871c73fd0e78de lrc: 4/0,0 mode: COS/COS res: [0x20003d491:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.189089:0:3309:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003d491:0x1:0x0].0x0 (ffff8800aa4b4400) 00010000:00010000:2.0:1736366117.189090:0:3309:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1736366117.189091:0:3309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880084139d40/0x98871c73fd0e78de lrc: 2/0,0 mode: --/COS res: [0x20003d491:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1736366117.189092:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1736366117.189098:0:3309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880084139d40/0x98871c73fd0e78de lrc: 0/0,0 mode: --/COS res: [0x20003d491:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1736366117.189106:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3325:1820703013015424:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1736366117.189151:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366117.189186:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013015424 00000100:00100000:0.0:1736366117.189215:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94691 00000100:00100000:0.0:1736366117.189219:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd79300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1820703013015424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1736366117.189252:0:9254:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:17898 count 1 00010000:00010000:0.0:1736366117.189269:0:9254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78ec lrc: 3/0,1 mode: --/PW res: [0x45ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366117.189288:0:9254:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99b00/0x98871c73fd0e749a lrc: 2/0,0 mode: PR/PR res: [0x45ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe249e3 expref: 5 pid: 24518 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1736366117.189295:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366117.189297:0:9254:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1736366117.189299:0:9254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78ec lrc: 4/0,1 mode: --/PW res: [0x45ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366117.189319:0:9254:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99b00/0x98871c73fd0e749a lrc: 3/0,0 mode: PR/PR res: [0x45ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.2@tcp remote: 0x50df2825ebe249e3 expref: 5 pid: 24518 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1736366117.189330:0:9254:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99b00/0x98871c73fd0e749a lrc: 4/0,0 mode: PR/PR res: [0x45ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.2@tcp remote: 0x50df2825ebe249e3 expref: 5 pid: 24518 timeout: 8565 lvb_type: 1 00000100:00100000:0.0:1736366117.189340:0:9254:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f6d40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9254:1820703013015488:192.168.201.2@tcp:104: 00000100:00100000:0.0:1736366117.189386:0:9254:0:(client.c:2492:ptlrpc_set_wait()) set ffff880124819c00 going to sleep for 11 seconds 00000100:00100000:1.0:1736366117.190538:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366117.190550:0:9254:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f6d40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9254:1820703013015488:192.168.201.2@tcp:104: 00000100:00100000:1.0:1736366117.190557:0:9269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041011008 00010000:00010000:2.0:1736366117.190563:0:9254:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78ec lrc: 3/0,1 mode: --/PW res: [0x45ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.190571:0:9269:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99b00/0x98871c73fd0e749a lrc: 4/0,0 mode: PR/PR res: [0x45ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.2@tcp remote: 0x50df2825ebe249e3 expref: 6 pid: 24518 timeout: 8565 lvb_type: 1 00000100:00100000:1.0:1736366117.190590:0:9269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 65039 00000100:00100000:1.0:1736366117.190599:0:9269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a461d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041011008:12345-192.168.201.2@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1736366117.190607:0:9269:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1736366117.190611:0:9269:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99b00/0x98871c73fd0e749a lrc: 4/0,0 mode: PR/PR res: [0x45ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.2@tcp remote: 0x50df2825ebe249e3 expref: 6 pid: 24518 timeout: 8565 lvb_type: 1 00010000:00010000:1.0:1736366117.190620:0:9269:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99b00/0x98871c73fd0e749a lrc: 3/0,0 mode: PR/PR res: [0x45ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.2@tcp remote: 0x50df2825ebe249e3 expref: 6 pid: 24518 timeout: 8565 lvb_type: 1 00010000:00010000:1.0:1736366117.190659:0:9269:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8d99b00/0x98871c73fd0e749a lrc: 0/0,0 mode: --/PR res: [0x45ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.2@tcp remote: 0x50df2825ebe249e3 expref: 6 pid: 24518 timeout: 8565 lvb_type: 1 00010000:00010000:1.0:1736366117.190668:0:9269:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736366117.190670:0:9269:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1736366117.190672:0:9269:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78ec lrc: 3/0,1 mode: PW/PW res: [0x45ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.190678:0:9269:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78ec lrc: 4/0,1 mode: PW/PW res: [0x45ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.190698:0:9269:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1736366117.190710:0:9254:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78ec lrc: 3/0,1 mode: PW/PW res: [0x45ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.190715:0:9254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78ec lrc: 3/0,1 mode: PW/PW res: [0x45ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.190719:0:9254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78ec lrc: 3/0,1 mode: PW/PW res: [0x45ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.190722:0:9254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78ec lrc: 2/0,0 mode: PW/PW res: [0x45ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1736366117.190724:0:9269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a461d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1874:x1820703041011008:12345-192.168.201.2@tcp:103:ldlm_bl_01.0 Request processed in 125us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366117.190730:0:9269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 65039 00010000:00010000:2.0:1736366117.190733:0:9254:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366117.190769:0:14340:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1736366117.190772:0:14340:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78ec lrc: 2/0,0 mode: PW/PW res: [0x45ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.190778:0:14340:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800841398c0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1736366117.190780:0:14340:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78ec lrc: 2/0,0 mode: PW/PW res: [0x45ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.190786:0:14340:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78ec lrc: 3/0,0 mode: PW/PW res: [0x45ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.190795:0:14340:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78ec lrc: 1/0,0 mode: --/PW res: [0x45ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.190806:0:14340:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800841398c0/0x98871c73fd0e78ec lrc: 0/0,0 mode: --/PW res: [0x45ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.190819:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366117.190820:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366117.190821:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366117.190848:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd79300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3325:x1820703013015424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1628us (1697us total) trans 81604380090 rc 0/0 00000100:00100000:2.0:1736366117.190852:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94691 00000004:00080000:1.0:1736366117.190864:0:3325:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88012cd7b440/2, rc 0, transno 1466 00000100:00100000:1.0:1736366117.190868:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3325:1820703013015424:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1736366117.192861:0:23400:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 81604380090 is committed 00000100:00100000:2.0:1736366117.202940:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366117.202984:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041011072 00000100:00100000:0.0:1736366117.203018:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 835 00000100:00100000:0.0:1736366117.203023:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:15307:x1820703041011072:12345-192.168.201.2@tcp:101:lfs.0 00010000:00010000:0.0:1736366117.203035:0:25656:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1736366117.203048:0:25656:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008413af40/0x98871c73fd0e78f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50df2825ebe24a1b expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366117.203089:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008413a1c0/0x98871c73fd0e78fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366117.203106:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008413a1c0/0x98871c73fd0e78fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366117.203114:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008413a1c0/0x98871c73fd0e78fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1736366117.203142:0:25656:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1736366117.203145:0:25656:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 184 stripe count 1 MDT count 8 00000004:00010000:0.0:1736366117.203157:0:25656:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008413a1c0/0x98871c73fd0e78fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366117.203194:0:25656:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008413af40/0x98871c73fd0e78f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a1b expref: 7 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366117.203204:0:25656:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008413a1c0/0x98871c73fd0e78fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a1b expref: 6 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366117.203210:0:25656:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880070e8fe00) 00010000:00010000:0.0:1736366117.203213:0:25656:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1736366117.203215:0:25656:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008413a1c0, rc 0) 00000100:00100000:0.0:1736366117.203247:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:15307:x1820703041011072:12345-192.168.201.2@tcp:101:lfs.0 Request processed in 224us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366117.203254:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 835 00000100:00100000:0.0:1736366117.204476:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366117.204523:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041011136 00000100:00100000:1.0:1736366117.204549:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 836 00000100:00100000:1.0:1736366117.204553:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:15307:x1820703041011136:12345-192.168.201.2@tcp:41:lfs.0 00000004:00000024:1.0:1736366117.204570:0:25656:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1315590144 00000100:00100000:1.0:1736366117.204599:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:15307:x1820703041011136:12345-192.168.201.2@tcp:41:lfs.0 Request processed in 45us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366117.204605:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 836 00000100:00100000:2.0:1736366117.205263:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366117.205296:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041011200 00000100:00100000:0.0:1736366117.205321:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 837 00000100:00100000:0.0:1736366117.205325:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:15307:x1820703041011200:12345-192.168.201.2@tcp:41:lfs.0 00000004:00000024:0.0:1736366117.205349:0:25656:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445543936 avail 1316081664 00000100:00100000:0.0:1736366117.205378:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:15307:x1820703041011200:12345-192.168.201.2@tcp:41:lfs.0 Request processed in 52us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366117.205383:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 837 00000100:00100000:2.0:1736366117.206156:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366117.206207:0:9256:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041011264 00000100:00100000:0.0:1736366117.206224:0:9256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 5836 00000100:00100000:0.0:1736366117.206226:0:9256:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:15307:x1820703041011264:12345-192.168.201.2@tcp:13:lfs.0 00002000:00000024:0.0:1736366117.206235:0:9256:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8657664 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366117.206256:0:9256:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:15307:x1820703041011264:12345-192.168.201.2@tcp:13:lfs.0 Request processed in 29us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366117.206259:0:9256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 5836 00000100:00100000:0.0:1736366117.206752:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366117.206795:0:9256:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041011328 00000100:00100000:1.0:1736366117.206821:0:9256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 5837 00000100:00100000:1.0:1736366117.206825:0:9256:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:15307:x1820703041011328:12345-192.168.201.2@tcp:13:lfs.0 00002000:00000024:1.0:1736366117.206836:0:9256:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3923435520 avail 3691913216 00000100:00100000:1.0:1736366117.206868:0:9256:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:15307:x1820703041011328:12345-192.168.201.2@tcp:13:lfs.0 Request processed in 42us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366117.206874:0:9256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 5837 00000100:00100000:0.0:1736366117.217706:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366117.217758:0:25150:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041011392 00000100:00100000:2.0:1736366117.217786:0:25150:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 10 00000100:00100000:2.0:1736366117.217789:0:25150:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880133142140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:15314:x1820703041011392:12345-192.168.201.2@tcp:700:mcreate.0 00000100:00100000:2.0:1736366117.217822:0:25150:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880133142140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:15314:x1820703041011392:12345-192.168.201.2@tcp:700:mcreate.0 Request processed in 33us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366117.217826:0:25150:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 10 00000100:00100000:2.0:1736366117.218484:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366117.218529:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041011520 00000100:00100000:1.0:1736366117.218550:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 838 00000100:00100000:1.0:1736366117.218554:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d2084c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:15314:x1820703041011520:12345-192.168.201.2@tcp:36:mcreate.0 00010000:00010000:1.0:1736366117.218585:0:25656:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1736366117.218603:0:25656:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008413a1c0/0x98871c73fd0e78fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a1b expref: 6 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.218615:0:25656:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880070e8fe00) 00010000:00010000:1.0:1736366117.218621:0:25656:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1736366117.218687:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e7901 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.218696:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e7901 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.218704:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e7901 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.218713:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2880/0x98871c73fd0e7908 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.218718:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2880/0x98871c73fd0e7908 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.218724:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2880/0x98871c73fd0e7908 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.218970:0:25656:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e7901 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.218977:0:25656:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e7901 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.218991:0:25656:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e7901 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.218996:0:25656:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006fde0480 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:1.0:1736366117.218998:0:25656:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e7901 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.219003:0:25656:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e7901 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.219009:0:25656:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b7b3cd00) 00010000:00010000:1.0:1736366117.219011:0:25656:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1736366117.219013:0:25656:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e7901 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.219017:0:25656:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e7901 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1736366117.219028:0:25656:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88012d2084c0 reply state ffff880070fa7000 transno 541165879298 ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2880/0x98871c73fd0e7908 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1736366117.219081:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d2084c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+7:15314:x1820703041011520:12345-192.168.201.2@tcp:36:mcreate.0 Request processed in 526us (596us total) trans 541165879298 rc 0/0 00000100:00100000:1.0:1736366117.219087:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 838 00010000:00010000:1.0:1736366117.219656:0:3310:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2880/0x98871c73fd0e7908 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.219664:0:3310:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x174a82e8 (ffff8800b7b3cb00) 00010000:00010000:1.0:1736366117.219669:0:3310:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1736366117.223558:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366117.223601:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041011584 00000100:00100000:1.0:1736366117.223621:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 839 00000100:00100000:1.0:1736366117.223625:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+7:15317:x1820703041011584:12345-192.168.201.2@tcp:101:rm.0 00010000:00010000:1.0:1736366117.223647:0:25656:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1736366117.223655:0:25656:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2d00/0x98871c73fd0e790f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50df2825ebe24a22 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.223684:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde06c0/0x98871c73fd0e7916 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.223691:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde06c0/0x98871c73fd0e7916 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.223697:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde06c0/0x98871c73fd0e7916 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1736366117.223712:0:25656:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1736366117.223715:0:25656:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 185 stripe count 1 MDT count 8 00000004:00010000:1.0:1736366117.223724:0:25656:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde06c0/0x98871c73fd0e7916 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.223737:0:25656:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2d00/0x98871c73fd0e790f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a22 expref: 9 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.223747:0:25656:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde06c0/0x98871c73fd0e7916 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a22 expref: 8 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.223753:0:25656:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b7b3cc00) 00010000:00010000:1.0:1736366117.223754:0:25656:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1736366117.223760:0:25656:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88006fde06c0, rc 0) 00000100:00100000:1.0:1736366117.223789:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+8:15317:x1820703041011584:12345-192.168.201.2@tcp:101:rm.0 Request processed in 164us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366117.223795:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 839 00000100:00100000:1.0:1736366117.224519:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366117.224588:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041011648 00000100:00100000:2.0:1736366117.224612:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 840 00000100:00100000:2.0:1736366117.224615:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a593a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+8:15317:x1820703041011648:12345-192.168.201.2@tcp:101:rm.0 00010000:00010000:2.0:1736366117.224622:0:25656:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1736366117.224627:0:25656:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdfcc0/0x98871c73fd0e791d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50df2825ebe24a29 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224659:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7924 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224664:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7924 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224669:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7924 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224673:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc900/0x98871c73fd0e792b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224676:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc900/0x98871c73fd0e792b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224684:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc900/0x98871c73fd0e792b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224715:0:25656:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7932 lrc: 3/1,0 mode: --/PR res: [0x20003dc61:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224719:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7932 lrc: 3/1,0 mode: PR/PR res: [0x20003dc61:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224722:0:25656:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7932 lrc: 3/1,0 mode: PR/PR res: [0x20003dc61:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1736366117.224735:0:25656:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20003dc61:0x1:0x0]: returning size 0 00000004:00200000:2.0:1736366117.224737:0:25656:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1736366117.224743:0:25656:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7932 lrc: 3/1,0 mode: PR/PR res: [0x20003dc61:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224747:0:25656:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7932 lrc: 3/1,0 mode: PR/PR res: [0x20003dc61:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224750:0:25656:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7924 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224753:0:25656:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7924 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224756:0:25656:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7924 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224758:0:25656:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdeac0 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:2.0:1736366117.224763:0:25656:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7924 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224766:0:25656:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7924 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224771:0:25656:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b7b3cc00) 00010000:00010000:2.0:1736366117.224772:0:25656:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736366117.224773:0:25656:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7924 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224776:0:25656:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdeac0/0x98871c73fd0e7924 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224781:0:25656:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc900/0x98871c73fd0e792b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224784:0:25656:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc900/0x98871c73fd0e792b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224786:0:25656:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc900/0x98871c73fd0e792b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224789:0:25656:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdc900 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:2.0:1736366117.224790:0:25656:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc900/0x98871c73fd0e792b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224792:0:25656:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc900/0x98871c73fd0e792b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224795:0:25656:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x174a82e8 (ffff8800b7b3cb00) 00010000:00010000:2.0:1736366117.224799:0:25656:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736366117.224800:0:25656:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc900/0x98871c73fd0e792b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224803:0:25656:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc900/0x98871c73fd0e792b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224813:0:25656:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdfcc0/0x98871c73fd0e791d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a29 expref: 10 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224818:0:25656:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7932 lrc: 3/0,0 mode: PR/PR res: [0x20003dc61:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a29 expref: 9 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.224821:0:25656:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003dc61:0x1:0x0].0x0 (ffff8800b1b48400) 00010000:00010000:2.0:1736366117.224822:0:25656:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1736366117.224823:0:25656:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008dbdcfc0, rc 0) 00000100:00100000:2.0:1736366117.224848:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a593a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+9:15317:x1820703041011648:12345-192.168.201.2@tcp:101:rm.0 Request processed in 232us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366117.224852:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 840 00000100:00100000:0.0:1736366117.225883:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366117.225923:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041011776 00000100:00100000:1.0:1736366117.225949:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 841 00000100:00100000:1.0:1736366117.225953:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880133140980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+9:15317:x1820703041011776:12345-192.168.201.2@tcp:36:rm.0 00010000:00010000:1.0:1736366117.225972:0:26348:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1736366117.225981:0:26348:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e7932 lrc: 0/0,0 mode: --/PR res: [0x20003dc61:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a29 expref: 9 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.225990:0:26348:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003dc61:0x1:0x0].0x0 (ffff8800b1b48400) 00010000:00010000:1.0:1736366117.225994:0:26348:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1736366117.226003:0:26348:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7939 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226009:0:26348:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7939 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226015:0:26348:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7939 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226022:0:26348:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1200/0x98871c73fd0e7940 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226027:0:26348:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1200/0x98871c73fd0e7940 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226033:0:26348:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1200/0x98871c73fd0e7940 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226071:0:26348:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0240/0x98871c73fd0e7947 lrc: 3/0,1 mode: --/EX res: [0x20003dc61:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226077:0:26348:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0240/0x98871c73fd0e7947 lrc: 3/0,1 mode: EX/EX res: [0x20003dc61:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226083:0:26348:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0240/0x98871c73fd0e7947 lrc: 3/0,1 mode: EX/EX res: [0x20003dc61:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226218:0:26348:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2400/0x98871c73fd0e794e lrc: 3/0,1 mode: --/PW res: [0x20003dc61:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226225:0:26348:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2400/0x98871c73fd0e794e lrc: 3/0,1 mode: PW/PW res: [0x20003dc61:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134806387472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226232:0:26348:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2400/0x98871c73fd0e794e lrc: 3/0,1 mode: PW/PW res: [0x20003dc61:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134806387472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226238:0:26348:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2400/0x98871c73fd0e794e lrc: 4/0,1 mode: PW/PW res: [0x20003dc61:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134806387472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226242:0:26348:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2400/0x98871c73fd0e794e lrc: 4/0,1 mode: PW/PW res: [0x20003dc61:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134806387472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226247:0:26348:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2400/0x98871c73fd0e794e lrc: 3/0,0 mode: PW/PW res: [0x20003dc61:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134806387472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226266:0:26348:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1736366117.226276:0:26348:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff880133140980 reply state ffff880136948000 transno 541165879299 ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0240/0x98871c73fd0e7947 lrc: 3/0,1 mode: EX/EX res: [0x20003dc61:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.226285:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1736366117.226288:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2400/0x98871c73fd0e794e lrc: 2/0,0 mode: PW/PW res: [0x20003dc61:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134806387472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.226293:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006fde2400 already unused, calling callback (ffffffffa0811190) 00010000:00010000:2.0:1736366117.226294:0:8052:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2400/0x98871c73fd0e794e lrc: 2/0,0 mode: PW/PW res: [0x20003dc61:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134806387472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.226297:0:8052:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2400/0x98871c73fd0e794e lrc: 3/0,0 mode: PW/PW res: [0x20003dc61:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134806387472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.226309:0:8052:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003dc61:0x1:0x0].0x0 (ffff8800b7b3ce00) 00010000:00010000:2.0:1736366117.226310:0:8052:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1736366117.226312:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2400/0x98871c73fd0e794e lrc: 1/0,0 mode: --/PW res: [0x20003dc61:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134806387472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.226315:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2400/0x98871c73fd0e794e lrc: 0/0,0 mode: --/PW res: [0x20003dc61:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134806387472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.226321:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366117.226322:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366117.226322:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366117.226331:0:26348:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7939 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226337:0:26348:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7939 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226341:0:26348:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7939 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226346:0:26348:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006fde1440 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:1.0:1736366117.226347:0:26348:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7939 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226352:0:26348:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7939 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226359:0:26348:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b7b3cc00) 00010000:00010000:1.0:1736366117.226361:0:26348:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1736366117.226363:0:26348:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7939 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366117.226368:0:26348:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7939 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1736366117.226375:0:26348:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff880133140980 reply state ffff880136948000 transno 541165879299 ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1200/0x98871c73fd0e7940 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1736366117.226413:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880133140980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+10:15317:x1820703041011776:12345-192.168.201.2@tcp:36:rm.0 Request processed in 459us (531us total) trans 541165879299 rc 0/0 00000100:00100000:1.0:1736366117.226427:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 841 00010000:00010000:2.0:1736366117.227097:0:3309:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1200/0x98871c73fd0e7940 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.227105:0:3309:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x174a82e8 (ffff8800b7b3cb00) 00010000:00010000:2.0:1736366117.227106:0:3309:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736366117.227107:0:3309:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0240/0x98871c73fd0e7947 lrc: 3/0,1 mode: COS/COS res: [0x20003dc61:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366117.227111:0:3309:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003dc61:0x1:0x0].0x0 (ffff8800b7b3ce00) 00010000:00010000:2.0:1736366117.227112:0:3309:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000020:00000080:1.0:1736366117.459545:0:17429:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:1.0:1736366117.459551:0:17429:0:(class_obd.c:134:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:1.0:1736366117.459554:0:17429:0:(class_obd.c:141:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00010000:00010000:1.0:1736366117.743254:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366118.511878:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366118.511926:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366118.511953:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366118.511976:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366118.512014:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041011904 00000100:00100000:2.0:1736366118.512017:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366118.512047:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041011840 00000100:00100000:2.0:1736366118.512051:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041012032 00000100:00100000:3.0:1736366118.512059:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041011968 00000100:00100000:3.0:1736366118.512080:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 649 00000100:00100000:1.0:1736366118.512086:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 161 00000100:00100000:3.0:1736366118.512086:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d208e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+10:1876:x1820703041011904:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366118.512089:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041012096 00000100:00100000:1.0:1736366118.512092:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1877:x1820703041011840:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366118.512113:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 7185 00010000:00000080:3.0:1736366118.512116:0:26348:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d208e40 x1820703041011904/t0(0) o400->cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b@192.168.201.2@tcp:514/0 lens 224/224 e 0 to 0 dl 1736366124 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:2.0:1736366118.512132:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d2097c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1876:x1820703041012032:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366118.512158:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1877:x1820703041011840:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 66us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366118.512189:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d208e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+10:1876:x1820703041011904:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 102us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366118.512194:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 161 00000100:00100000:3.0:1736366118.512209:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 649 00000100:00100000:2.0:1736366118.512220:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d2097c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1876:x1820703041012032:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 89us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366118.512227:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 650 00000100:00100000:2.0:1736366118.512229:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 7185 00000100:00100000:3.0:1736366118.512231:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1877:x1820703041011968:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366118.512241:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 7186 00000100:00100000:1.0:1736366118.512245:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1877:x1820703041012096:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366118.512261:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1877:x1820703041011968:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 30us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366118.512267:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 650 00000100:00100000:1.0:1736366118.512271:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1877:x1820703041012096:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 25us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366118.512277:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 7186 00000100:00100000:2.0:1736366118.543243:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3323:1820703013015552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1736366118.543279:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3324:1820703013015616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1736366118.543279:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366118.543303:0:9256:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013015552 00000100:00100000:0.0:1736366118.543320:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366118.543333:0:9256:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013015616 00000100:00100000:2.0:1736366118.543340:0:9257:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5838 00000100:00100000:2.0:1736366118.543345:0:9257:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1820703013015552:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1736366118.543346:0:9256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5839 00000100:00100000:1.0:1736366118.543350:0:9256:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880133144c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1820703013015616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1736366118.543366:0:9257:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3923435520 avail 3691913216 00002000:00000024:1.0:1736366118.543367:0:9256:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8657664 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366118.543395:0:9257:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1820703013015552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366118.543400:0:9257:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5838 00000100:00100000:1.0:1736366118.543404:0:9256:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880133144c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1820703013015616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366118.543409:0:9256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5839 00000100:00100000:0.0:1736366118.543425:0:3324:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 81604380090 gen 2 00000004:00080000:0.0:1736366118.543430:0:3324:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88012cd7b440, transno 81604380090 00000100:00100000:2.0:1736366118.543431:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3323:1820703013015552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1736366118.543445:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3324:1820703013015616:0@lo:13:osp-pre-0-0.0 00000040:00100000:1.0:1736366118.543457:0:16281:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 2 in log [0x1f8:0x1:0x0] 00000100:00100000:1.0:1736366118.735334:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880133141c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013015680:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366118.735375:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880133142600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3323:1820703013015808:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366118.735398:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366118.735400:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3326:1820703013015744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1736366118.735421:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366118.735444:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366118.735444:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013016064:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366118.735445:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880133142ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3325:1820703013015936:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366118.735462:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013016000:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366118.735463:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013015680 00000100:00100000:3.0:1736366118.735464:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366118.735469:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366118.735483:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880133143dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013015872:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366118.735484:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3323:1820703013016320:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366118.735490:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013016192:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366118.735501:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366118.735502:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366118.735506:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1736366118.735509:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366118.735513:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+23:3325:x1820703013015680:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366118.735528:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013016128:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366118.735532:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013015808 00000100:00100000:1.0:1736366118.735540:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013015744 00000100:00100000:0.0:1736366118.735547:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366118.735558:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3324:1820703013016384:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366118.735559:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013015936 00000100:00100000:1.0:1736366118.735564:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016064 00000100:00100000:3.0:1736366118.735570:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013015872 00000100:00100000:1.0:1736366118.735573:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016320 00000100:00100000:2.0:1736366118.735574:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+23:3325:x1820703013015680:12345-0@lo:400:kworker/u8:1.0 Request processed in 61us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366118.735577:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366118.735581:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77049 00000100:00100000:3.0:1736366118.735581:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016384 00000100:00100000:2.0:1736366118.735582:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1736366118.735586:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3326:x1820703013015744:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1736366118.735590:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:3.0:1736366118.735595:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1820703013015808:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366118.735628:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:0.0:1736366118.735634:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1820703013015936:12345-0@lo:400:kworker/u8:1.0 00000004:00000024:1.0:1736366118.735635:0:9264:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445543936 avail 1316081664 00010000:00000080:3.0:1736366118.735636:0:16831:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880099ad0e40 x1820703013015808/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:514/0 lens 224/224 e 0 to 0 dl 1736366124 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:2.0:1736366118.735639:0:9263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77050 00000100:00100000:2.0:1736366118.735643:0:9263:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013016064:12345-0@lo:400:kworker/u8:1.0 00010000:00000080:0.0:1736366118.735651:0:26348:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012cd7b440 x1820703013015936/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:514/0 lens 224/224 e 0 to 0 dl 1736366124 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00010000:00000080:2.0:1736366118.735656:0:9263:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880099ad3dc0 x1820703013016064/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:514/0 lens 224/224 e 0 to 0 dl 1736366124 ref 1 fl Interpret:/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:1.0:1736366118.735677:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3326:x1820703013015744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366118.735684:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77049 00000100:00100000:3.0:1736366118.735686:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1820703013015808:12345-0@lo:400:kworker/u8:1.0 Request processed in 90us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366118.735687:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1820703013015936:12345-0@lo:400:kworker/u8:1.0 Request processed in 54us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366118.735692:0:9263:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013016064:12345-0@lo:400:kworker/u8:1.0 Request processed in 49us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366118.735693:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1736366118.735698:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77051 00000100:00100000:1.0:1736366118.735701:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3323:x1820703013016320:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366118.735704:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1736366118.735709:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:2.0:1736366118.735710:0:9263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77050 00000100:00100000:0.0:1736366118.735722:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1736366118.735723:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013015872:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366118.735724:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3323:x1820703013016320:12345-0@lo:400:kworker/u8:1.0 Request processed in 22us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366118.735725:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1820703013016384:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366118.735730:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77051 00010000:00000080:0.0:1736366118.735734:0:26348:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880073ab2ac0 x1820703013016384/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:514/0 lens 224/224 e 0 to 0 dl 1736366124 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:1.0:1736366118.735752:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016192 00000100:00100000:3.0:1736366118.735761:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013015872:12345-0@lo:400:kworker/u8:1.0 Request processed in 39us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366118.735762:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1820703013016384:12345-0@lo:400:kworker/u8:1.0 Request processed in 36us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366118.735767:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1736366118.735770:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:1.0:1736366118.735772:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016128 00000100:00100000:1.0:1736366118.735785:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7187 00000100:00100000:1.0:1736366118.735788:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013016192:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366118.735791:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7188 00000100:00100000:2.0:1736366118.735796:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab04c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013016128:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366118.735804:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3323:1820703013016320:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366118.735810:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013016192:12345-0@lo:400:kworker/u8:1.0 Request processed in 21us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366118.735811:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366118.735815:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880133142600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3323:1820703013015808:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366118.735823:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013016064:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366118.735824:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3326:1820703013016256:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366118.735828:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7187 00000100:00100000:2.0:1736366118.735831:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab04c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013016128:12345-0@lo:400:kworker/u8:1.0 Request processed in 35us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366118.735836:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7188 00000100:00100000:0.0:1736366118.735843:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366118.735860:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880133142ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3325:1820703013015936:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366118.735860:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016000 00000100:00100000:1.0:1736366118.735870:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013016192:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366118.735871:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3326:1820703013015744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1736366118.735875:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016256 00000100:00100000:1.0:1736366118.735878:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880133141c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013015680:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366118.735886:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:2.0:1736366118.735890:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013016000:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366118.735890:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1736366118.735893:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3326:x1820703013016256:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366118.735896:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880133143dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013015872:0@lo:400:kworker/u8:1.0 00010000:00000080:3.0:1736366118.735903:0:16831:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880073ab17c0 x1820703013016256/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:514/0 lens 224/224 e 0 to 0 dl 1736366124 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:0.0:1736366118.735905:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013016128:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366118.735924:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013016000:12345-0@lo:400:kworker/u8:1.0 Request processed in 33us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366118.735925:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3324:1820703013016384:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366118.735932:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1736366118.735932:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3326:x1820703013016256:12345-0@lo:400:kworker/u8:1.0 Request processed in 36us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366118.735938:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1736366118.735950:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013016000:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366118.735958:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3326:1820703013016256:0@lo:400:kworker/u8:1.0 00010000:00010000:2.0:1736366118.745396:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1736366118.939497:0:17824:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1736366118.939501:0:17824:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1736366118.962700:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366118.962846:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041012160 00000100:00100000:1.0:1736366118.962908:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 842 00000100:00100000:1.0:1736366118.962915:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+10:15390:x1820703041012160:12345-192.168.201.2@tcp:101:lfs.0 00010000:00010000:1.0:1736366118.962937:0:26348:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1736366118.962955:0:26348:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde3a80/0x98871c73fd0e7955 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50df2825ebe24a30 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963010:0:26348:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde3cc0/0x98871c73fd0e795c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963024:0:26348:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde3cc0/0x98871c73fd0e795c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963037:0:26348:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde3cc0/0x98871c73fd0e795c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963049:0:26348:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2ac0/0x98871c73fd0e7963 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963056:0:26348:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2ac0/0x98871c73fd0e7963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963062:0:26348:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2ac0/0x98871c73fd0e7963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963122:0:26348:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde3cc0/0x98871c73fd0e795c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963129:0:26348:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde3cc0/0x98871c73fd0e795c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963135:0:26348:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde3cc0/0x98871c73fd0e795c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963141:0:26348:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006fde3cc0 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:1.0:1736366118.963144:0:26348:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde3cc0/0x98871c73fd0e795c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963151:0:26348:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde3cc0/0x98871c73fd0e795c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963195:0:26348:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b7b3cc00) 00010000:00010000:1.0:1736366118.963199:0:26348:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1736366118.963202:0:26348:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde3cc0/0x98871c73fd0e795c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963208:0:26348:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde3cc0/0x98871c73fd0e795c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963219:0:26348:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2ac0/0x98871c73fd0e7963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963224:0:26348:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2ac0/0x98871c73fd0e7963 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963241:0:26348:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2ac0/0x98871c73fd0e7963 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963246:0:26348:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006fde2ac0 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:1.0:1736366118.963248:0:26348:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2ac0/0x98871c73fd0e7963 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963253:0:26348:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2ac0/0x98871c73fd0e7963 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963260:0:26348:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7fda96f6 (ffff88008c46c900) 00010000:00010000:1.0:1736366118.963262:0:26348:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1736366118.963264:0:26348:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2ac0/0x98871c73fd0e7963 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963269:0:26348:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2ac0/0x98871c73fd0e7963 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963308:0:26348:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde3a80/0x98871c73fd0e7955 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a30 expref: 11 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963316:0:26348:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde3a80/0x98871c73fd0e7955 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a30 expref: 11 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.963324:0:26348:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88006fde3a80, rc 0) 00010000:00000080:1.0:1736366118.963329:0:26348:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d20bdc0 x1820703041012160/t0(0) o101->cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b@192.168.201.2@tcp:514/0 lens 592/640 e 0 to 0 dl 1736366124 ref 1 fl Interpret:/0/0 rc 301/0 job:'lfs.0' 00000100:00100000:1.0:1736366118.963397:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+10:15390:x1820703041012160:12345-192.168.201.2@tcp:101:lfs.0 Request processed in 482us (701us total) trans 0 rc 301/301 00000100:00100000:1.0:1736366118.963411:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 842 00000100:00100000:2.0:1736366118.965322:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366118.965415:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041012288 00000100:00100000:1.0:1736366118.965472:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 843 00000100:00100000:1.0:1736366118.965481:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+10:15390:x1820703041012288:12345-192.168.201.2@tcp:101:lfs.0 00010000:00010000:1.0:1736366118.965497:0:26348:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1736366118.965512:0:26348:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2400/0x98871c73fd0e796a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50df2825ebe24a37 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.965593:0:26348:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7971 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.965640:0:26348:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7971 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.965655:0:26348:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7971 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.965668:0:26348:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2d00/0x98871c73fd0e7978 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.965675:0:26348:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2d00/0x98871c73fd0e7978 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.965681:0:26348:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2d00/0x98871c73fd0e7978 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.966013:0:26348:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e797f lrc: 3/1,0 mode: --/CR res: [0x20003dc61:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.966036:0:26348:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e797f lrc: 3/1,0 mode: CR/CR res: [0x20003dc61:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.966044:0:26348:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e797f lrc: 3/1,0 mode: CR/CR res: [0x20003dc61:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1736366118.966055:0:26348:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20003dc61:0x2:0x0]: returning size 0 00010000:00010000:1.0:1736366118.966082:0:26348:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7971 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.966088:0:26348:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7971 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.966093:0:26348:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7971 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.966099:0:26348:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006fde1440 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:1.0:1736366118.966101:0:26348:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7971 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.966107:0:26348:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7971 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.966114:0:26348:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b7b3cc00) 00010000:00010000:1.0:1736366118.966117:0:26348:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1736366118.966119:0:26348:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7971 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.966124:0:26348:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1440/0x98871c73fd0e7971 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1736366118.966140:0:26348:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88012d20a140 reply state ffff880123c8e000 transno 541165879300 ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2d00/0x98871c73fd0e7978 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.966195:0:26348:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2400/0x98871c73fd0e796a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a37 expref: 13 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.966208:0:26348:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e797f lrc: 3/0,0 mode: CR/CR res: [0x20003dc61:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a37 expref: 12 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366118.966214:0:26348:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003dc61:0x2:0x0].0x0 (ffff88008c46c800) 00010000:00010000:1.0:1736366118.966216:0:26348:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1736366118.966218:0:26348:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88006fde0480, rc 0) 00010000:00000080:1.0:1736366118.966224:0:26348:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d20a140 x1820703041012288/t541165879300(0) o101->cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b@192.168.201.2@tcp:514/0 lens 536/600 e 0 to 0 dl 1736366124 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:1.0:1736366118.966295:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+13:15390:x1820703041012288:12345-192.168.201.2@tcp:101:lfs.0 Request processed in 812us (973us total) trans 541165879300 rc 0/0 00000100:00100000:1.0:1736366118.966307:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 843 00010000:00010000:0.0:1736366118.967579:0:3310:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2d00/0x98871c73fd0e7978 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366118.967591:0:3310:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7fda96f6 (ffff88008c46c000) 00010000:00010000:0.0:1736366118.967594:0:3310:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1736366118.968261:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366118.968296:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041012416 00000100:00100000:2.0:1736366118.968326:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 844 00000100:00100000:2.0:1736366118.968331:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+13:15390:x1820703041012416:12345-192.168.201.2@tcp:101:lfs.0 00010000:00010000:2.0:1736366118.968346:0:26348:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1736366118.968356:0:26348:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e798d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50df2825ebe24a3e expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366118.968409:0:26348:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 3/0,1 mode: --/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366118.968421:0:26348:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e797f lrc: 2/0,0 mode: CR/CR res: [0x20003dc61:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a37 expref: 14 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366118.968441:0:26348:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 4/0,1 mode: --/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366118.968471:0:26348:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e797f lrc: 3/0,0 mode: CR/CR res: [0x20003dc61:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a37 expref: 14 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366118.968483:0:26348:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e797f lrc: 4/0,0 mode: CR/CR res: [0x20003dc61:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a37 expref: 14 pid: 26348 timeout: 8567 lvb_type: 0 00000100:00100000:2.0:1736366118.968495:0:26348:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d208000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:26348:1820703013016448:192.168.201.2@tcp:104: 00000100:00100000:2.0:1736366118.968542:0:26348:0:(client.c:2492:ptlrpc_set_wait()) set ffff880091ec33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1736366118.969815:0:26348:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d208000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:26348:1820703013016448:192.168.201.2@tcp:104: 00010000:00010000:3.0:1736366118.969834:0:26348:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 3/0,1 mode: --/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1736366118.969921:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366118.969977:0:9269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041012480 00010000:00010000:2.0:1736366118.970017:0:9269:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e797f lrc: 4/0,0 mode: CR/CR res: [0x20003dc61:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a37 expref: 15 pid: 26348 timeout: 8567 lvb_type: 0 00000100:00100000:2.0:1736366118.970057:0:9269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 65040 00000100:00100000:2.0:1736366118.970063:0:9269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab3900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+15:1874:x1820703041012480:12345-192.168.201.2@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1736366118.970074:0:9269:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1736366118.970078:0:9269:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e797f lrc: 4/0,0 mode: CR/CR res: [0x20003dc61:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a37 expref: 15 pid: 26348 timeout: 8567 lvb_type: 0 00010000:00010000:2.0:1736366118.970089:0:9269:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e797f lrc: 3/0,0 mode: CR/CR res: [0x20003dc61:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a37 expref: 15 pid: 26348 timeout: 8567 lvb_type: 0 00010000:00010000:2.0:1736366118.970104:0:9269:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0480/0x98871c73fd0e797f lrc: 0/0,0 mode: --/CR res: [0x20003dc61:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a37 expref: 15 pid: 26348 timeout: 8567 lvb_type: 0 00010000:00010000:2.0:1736366118.970129:0:9269:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003dc61:0x2:0x0].0x0 (ffff88008c46c800) 00010000:00010000:2.0:1736366118.970132:0:9269:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 3/0,1 mode: --/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366118.970140:0:9269:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 3/0,1 mode: EX/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366118.970146:0:9269:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 4/0,1 mode: EX/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366118.970213:0:9269:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1736366118.970217:0:26348:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 3/0,1 mode: EX/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366118.970227:0:26348:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 3/0,1 mode: EX/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1736366118.970243:0:9269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab3900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+14:1874:x1820703041012480:12345-192.168.201.2@tcp:103:ldlm_bl_02.0 Request processed in 179us (326us total) trans 0 rc 0/0 00000004:00200000:3.0:1736366118.970248:0:26348:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20003dc61:0x2:0x0]: returning size 0 00000100:00100000:2.0:1736366118.970251:0:9269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 65040 00010000:00010000:3.0:1736366118.970369:0:26348:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 3/0,1 mode: EX/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366118.970377:0:26348:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 2/0,0 mode: EX/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366118.970382:0:26348:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 3/0,0 mode: EX/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366118.970387:0:26348:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008dbdc240 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:3.0:1736366118.970390:0:26348:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 3/0,0 mode: EX/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366118.970395:0:26348:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 4/0,0 mode: EX/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366118.970404:0:26348:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003dc61:0x2:0x0].0x0 (ffff88008c46c800) 00010000:00010000:3.0:1736366118.970406:0:26348:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1736366118.970408:0:26348:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 2/0,0 mode: --/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366118.970414:0:26348:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdc240/0x98871c73fd0e7994 lrc: 0/0,0 mode: --/EX res: [0x20003dc61:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366118.970458:0:26348:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e798d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a3e expref: 14 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366118.970463:0:26348:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbdcfc0/0x98871c73fd0e798d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a3e expref: 14 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366118.970472:0:26348:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008dbdcfc0, rc 0) 00010000:00000080:3.0:1736366118.970475:0:26348:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880073ab5f00 x1820703041012416/t541165879301(0) o101->cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b@192.168.201.2@tcp:514/0 lens 712/816 e 0 to 0 dl 1736366124 ref 1 fl Interpret:/0/0 rc 301/0 job:'lfs.0' 00000100:00100000:3.0:1736366118.970545:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+13:15390:x1820703041012416:12345-192.168.201.2@tcp:101:lfs.0 Request processed in 2213us (2288us total) trans 541165879301 rc 301/301 00000100:00100000:3.0:1736366118.970554:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 844 00000100:00100000:0.0:1736366118.971996:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366118.972126:0:25144:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041012608 00000100:00100000:2.0:1736366118.972198:0:25144:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 107 00000100:00100000:2.0:1736366118.972204:0:25144:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+13:15390:x1820703041012608:12345-192.168.201.2@tcp:35:lfs.0 00010000:00000080:2.0:1736366118.972316:0:25144:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880073ab7200 x1820703041012608/t541165879302(0) o35->cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b@192.168.201.2@tcp:514/0 lens 392/456 e 0 to 0 dl 1736366124 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:2.0:1736366118.972357:0:25144:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+14:15390:x1820703041012608:12345-192.168.201.2@tcp:35:lfs.0 Request processed in 153us (367us total) trans 541165879302 rc 0/0 00000100:00100000:2.0:1736366118.972365:0:25144:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 107 00000100:00100000:2.0:1736366118.974001:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366118.974125:0:25144:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041012736 00000100:00100000:3.0:1736366118.974196:0:25144:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 108 00000100:00100000:3.0:1736366118.974202:0:25144:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801248ea850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+14:15390:x1820703041012736:12345-192.168.201.2@tcp:35:lfs.0 00010000:00000080:3.0:1736366118.974298:0:25144:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801248ea850 x1820703041012736/t541165879303(0) o35->cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b@192.168.201.2@tcp:514/0 lens 392/456 e 0 to 0 dl 1736366124 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:3.0:1736366118.974338:0:25144:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801248ea850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+15:15390:x1820703041012736:12345-192.168.201.2@tcp:35:lfs.0 Request processed in 137us (342us total) trans 541165879303 rc 0/0 00000100:00100000:3.0:1736366118.974347:0:25144:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 108 00000020:01000004:1.0:1736366119.475390:0:17953:0:(obd_mount_server.c:1591:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1736366119.475404:0:17953:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.102@tcp lock: ffff88006ef1ad00/0x98871c73fd0e75ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x98871c73fd0e75b2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.475414:0:17953:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.102@tcp lock: ffff88006ef1ad00/0x98871c73fd0e75ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x98871c73fd0e75b2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.475418:0:17953:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.102@tcp lock: ffff88006ef1ad00/0x98871c73fd0e75ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x98871c73fd0e75b2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.475421:0:17953:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.102@tcp lock: ffff88006ef1ad00/0x98871c73fd0e75ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x98871c73fd0e75b2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.475442:0:17953:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1736366119.475447:0:17953:0:(mgc_request.c:544:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1736366119.475456:0:17953:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1736366119.475459:0:17953:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1736366119.475459:0:6822:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:1.0:1736366119.475463:0:17953:0:(pinger.c:414:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1736366119.475464:0:6822:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.102@tcp lock: ffff88006ef1ad00/0x98871c73fd0e75ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x98871c73fd0e75b2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.475477:0:6822:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006ef1ad00 already unused, calling callback (ffffffffa0ae15c0) 10000000:00010000:2.0:1736366119.475478:0:6822:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.102@tcp lock: ffff88006ef1ad00/0x98871c73fd0e75ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x98871c73fd0e75b2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1736366119.475480:0:17953:0:(import.c:86:import_set_state_nolock()) ffff88009534e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1736366119.475483:0:6822:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.102@tcp lock: ffff88006ef1ad00/0x98871c73fd0e75ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x98871c73fd0e75b2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1736366119.475486:0:6822:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.102@tcp lock: ffff88006ef1ad00/0x98871c73fd0e75ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x98871c73fd0e75b2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1736366119.475489:0:6822:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1736366119.475490:0:6822:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1736366119.475492:0:6822:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1736366119.475494:0:17953:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd784c0 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-lwp-MDT0000_UUID:17953:1820703013016512:0@lo:39:umount.0 00010000:00010000:2.0:1736366119.475509:0:6822:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.102@tcp lock: ffff88006ef1ad00/0x98871c73fd0e75ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e75b2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.475512:0:6822:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1736366119.475531:0:6822:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.102@tcp lock: ffff88006ef1ad00/0x98871c73fd0e75ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e75b2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.475536:0:6822:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.102@tcp lock: ffff88006ef1ad00/0x98871c73fd0e75ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e75b2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1736366119.475541:0:17953:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1736366119.475553:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366119.475554:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366119.475555:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366119.475565:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013016576:0@lo:103:ldlm_bl_01.0 00000100:00100000:1.0:1736366119.475568:0:17953:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008927d480 going to sleep for 5 seconds 00000100:00100000:3.0:1736366119.475574:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016512 00000100:00100000:0.0:1736366119.475607:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366119.475615:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:3.0:1736366119.475619:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:17953:x1820703013016512:12345-0@lo:39:umount.0 00000100:00100000:2.0:1736366119.475628:0:9269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016576 00000020:00000080:3.0:1736366119.475639:0:26348:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x98871c73fd0e76ca 00000100:00080000:3.0:1736366119.475643:0:26348:0:(import.c:86:import_set_state_nolock()) ffff8800739e0800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:1.0:1736366119.475656:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366119.475661:0:9269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18007 00000100:00100000:2.0:1736366119.475664:0:9269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+23:3325:x1820703013016576:12345-0@lo:103:ldlm_bl_01.0 00010000:00010000:2.0:1736366119.475671:0:9269:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1736366119.475683:0:9269:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a8d9bcc0/0x98871c73fd0e75b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98871c73fd0e75ab expref: 23 pid: 16273 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.475690:0:9269:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00000080:3.0:1736366119.475692:0:26348:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012cd7f6c0 x1820703013016512/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:515/0 lens 224/224 e 0 to 0 dl 1736366125 ref 1 fl Interpret:/0/0 rc 0/0 job:'umount.0' 00000100:00100000:2.0:1736366119.475714:0:9269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+22:3325:x1820703013016576:12345-0@lo:103:ldlm_bl_01.0 Request processed in 49us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366119.475718:0:9269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18007 00000100:00100000:3.0:1736366119.475718:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:17953:x1820703013016512:12345-0@lo:39:umount.0 Request processed in 99us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366119.475721:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1736366119.475728:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013016576:0@lo:103:ldlm_bl_01.0 00000020:00000080:3.0:1736366119.475729:0:26348:0:(genops.c:985:class_export_put()) final put ffff8800739e4800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1736366119.475734:0:17953:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd784c0 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-lwp-MDT0000_UUID:17953:1820703013016512:0@lo:39:umount.0 00000100:00080000:1.0:1736366119.475746:0:17953:0:(import.c:86:import_set_state_nolock()) ffff88009534e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:0.0:1736366119.475748:0:30346:0:(genops.c:944:class_export_destroy()) destroying export ffff8800739e4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1736366119.475748:0:17953:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1736366119.475749:0:17953:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1736366119.475750:0:17953:0:(import.c:339:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1736366119.475780:0:30346:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff8800739e0800 for lustre-MDT0000 00010000:00010000:1.0:1736366119.476374:0:17953:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.102@tcp lock: ffff88008db6cb40/0x98871c73fd0e74d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x98871c73fd0e74e0 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.476379:0:17953:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.102@tcp lock: ffff88008db6cb40/0x98871c73fd0e74d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x98871c73fd0e74e0 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.476382:0:17953:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.102@tcp lock: ffff88008db6cb40/0x98871c73fd0e74d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x98871c73fd0e74e0 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.476384:0:17953:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.102@tcp lock: ffff88008db6cb40/0x98871c73fd0e74d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x98871c73fd0e74e0 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.476395:0:17953:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1736366119.476403:0:17953:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.102@tcp lock: ffff88006fde1680/0x98871c73fd0e75ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98871c73fd0e75d5 expref: -99 pid: 6831 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.476408:0:17953:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.102@tcp lock: ffff88006fde1680/0x98871c73fd0e75ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98871c73fd0e75d5 expref: -99 pid: 6831 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.476412:0:17953:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.102@tcp lock: ffff88006fde1680/0x98871c73fd0e75ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x98871c73fd0e75d5 expref: -99 pid: 6831 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.476417:0:17953:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.102@tcp lock: ffff88006fde1680/0x98871c73fd0e75ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x98871c73fd0e75d5 expref: -99 pid: 6831 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.476430:0:17953:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1736366119.476434:0:17953:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.102@tcp lock: ffff88006fde1d40/0x98871c73fd0e759d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x98871c73fd0e75a4 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.476438:0:17953:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.102@tcp lock: ffff88006fde1d40/0x98871c73fd0e759d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x98871c73fd0e75a4 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.476442:0:17953:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.102@tcp lock: ffff88006fde1d40/0x98871c73fd0e759d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x98871c73fd0e75a4 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.476443:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1736366119.476447:0:17953:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.102@tcp lock: ffff88006fde1d40/0x98871c73fd0e759d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x98871c73fd0e75a4 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.476447:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.102@tcp lock: ffff88008db6cb40/0x98871c73fd0e74d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x98871c73fd0e74e0 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.476453:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008db6cb40 already unused, calling callback (ffffffffa0ae15c0) 10000000:00010000:2.0:1736366119.476454:0:8052:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.102@tcp lock: ffff88008db6cb40/0x98871c73fd0e74d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x98871c73fd0e74e0 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.476458:0:8052:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.102@tcp lock: ffff88008db6cb40/0x98871c73fd0e74d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x98871c73fd0e74e0 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1736366119.476460:0:8052:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.102@tcp lock: ffff88008db6cb40/0x98871c73fd0e74d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x98871c73fd0e74e0 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.476461:0:17953:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1736366119.476463:0:8052:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1736366119.476464:0:6823:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1736366119.476464:0:17953:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.102@tcp lock: ffff88008db6d8c0/0x98871c73fd0e74cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98871c73fd0e74d2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1736366119.476464:0:8052:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1736366119.476468:0:6823:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.102@tcp lock: ffff88006fde1680/0x98871c73fd0e75ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x98871c73fd0e75d5 expref: -99 pid: 6831 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.476469:0:17953:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.102@tcp lock: ffff88008db6d8c0/0x98871c73fd0e74cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98871c73fd0e74d2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.476473:0:17953:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.102@tcp lock: ffff88008db6d8c0/0x98871c73fd0e74cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x98871c73fd0e74d2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.476474:0:8052:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.102@tcp lock: ffff88008db6cb40/0x98871c73fd0e74d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e74e0 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366119.476475:0:6823:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006fde1680 already unused, calling callback (ffffffffa0ae15c0) 10000000:00010000:0.0:1736366119.476476:0:6823:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.102@tcp lock: ffff88006fde1680/0x98871c73fd0e75ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x98871c73fd0e75d5 expref: -99 pid: 6831 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.476477:0:8052:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1736366119.476480:0:17953:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.102@tcp lock: ffff88008db6d8c0/0x98871c73fd0e74cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x98871c73fd0e74d2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366119.476482:0:6823:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.102@tcp lock: ffff88006fde1680/0x98871c73fd0e75ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x98871c73fd0e75d5 expref: -99 pid: 6831 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.476486:0:17953:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1736366119.476486:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.102@tcp lock: ffff88008db6cb40/0x98871c73fd0e74d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e74e0 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1736366119.476488:0:17953:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1736366119.476489:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.102@tcp lock: ffff88008db6cb40/0x98871c73fd0e74d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e74e0 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1736366119.476490:0:17953:0:(mgc_request.c:544:config_log_end()) end config log lustre-MDT0000 (0) 10000000:00010000:0.0:1736366119.476495:0:6823:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.102@tcp lock: ffff88006fde1680/0x98871c73fd0e75ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x98871c73fd0e75d5 expref: -99 pid: 6831 timeout: 0 lvb_type: 0 00000020:01000004:1.0:1736366119.476496:0:17953:0:(obd_mount_server.c:1629:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1736366119.476499:0:17953:0:(obd_config.c:2324:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 10000000:01000000:0.0:1736366119.476500:0:6823:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000020:00000080:1.0:1736366119.476501:0:17953:0:(obd_config.c:1384:class_process_config()) processing cmd: cf004 10000000:01000000:0.0:1736366119.476502:0:6823:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1736366119.476502:0:8052:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:0.0:1736366119.476503:0:6823:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1736366119.476503:0:8052:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.102@tcp lock: ffff88006fde1d40/0x98871c73fd0e759d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x98871c73fd0e75a4 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00000020:02000400:1.0:1736366119.476504:0:17953:0:(obd_config.c:854:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1736366119.476506:0:8052:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006fde1d40 already unused, calling callback (ffffffffa0ae15c0) 10000000:00010000:2.0:1736366119.476507:0:8052:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.102@tcp lock: ffff88006fde1d40/0x98871c73fd0e759d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x98871c73fd0e75a4 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.476510:0:8052:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.102@tcp lock: ffff88006fde1d40/0x98871c73fd0e759d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x98871c73fd0e75a4 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1736366119.476512:0:8052:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.102@tcp lock: ffff88006fde1d40/0x98871c73fd0e759d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x98871c73fd0e75a4 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1736366119.476514:0:8052:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1736366119.476514:0:10475:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1736366119.476515:0:6823:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.102@tcp lock: ffff88006fde1680/0x98871c73fd0e75ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e75d5 expref: -99 pid: 6831 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1736366119.476515:0:8052:0:(mgc_request.c:1044:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1736366119.476517:0:8052:0:(mgc_request.c:153:config_log_put()) dropping config log params 00010000:00010000:3.0:1736366119.476518:0:10475:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.102@tcp lock: ffff88008db6d8c0/0x98871c73fd0e74cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x98871c73fd0e74d2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366119.476520:0:6823:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1736366119.476523:0:8052:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.102@tcp lock: ffff88006fde1d40/0x98871c73fd0e759d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e75a4 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366119.476523:0:10475:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008db6d8c0 already unused, calling callback (ffffffffa0ae15c0) 00010000:00010000:2.0:1736366119.476525:0:8052:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1736366119.476525:0:10475:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.102@tcp lock: ffff88008db6d8c0/0x98871c73fd0e74cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x98871c73fd0e74d2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366119.476528:0:10475:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.102@tcp lock: ffff88008db6d8c0/0x98871c73fd0e74cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x98871c73fd0e74d2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1736366119.476530:0:6823:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.102@tcp lock: ffff88006fde1680/0x98871c73fd0e75ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e75d5 expref: -99 pid: 6831 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.476530:0:8052:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.102@tcp lock: ffff88006fde1d40/0x98871c73fd0e759d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e75a4 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1736366119.476531:0:10475:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.102@tcp lock: ffff88008db6d8c0/0x98871c73fd0e74cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x98871c73fd0e74d2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.476532:0:8052:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.102@tcp lock: ffff88006fde1d40/0x98871c73fd0e759d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e75a4 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1736366119.476534:0:10475:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1736366119.476535:0:6823:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.102@tcp lock: ffff88006fde1680/0x98871c73fd0e75ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e75d5 expref: -99 pid: 6831 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1736366119.476535:0:10475:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1736366119.476536:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366119.476536:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1736366119.476536:0:10475:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1736366119.476537:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366119.476543:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366119.476543:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2084c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013016640:0@lo:103:ldlm_bl_03.0 00010000:00010000:0.0:1736366119.476544:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1736366119.476546:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366119.476548:0:10475:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.102@tcp lock: ffff88008db6d8c0/0x98871c73fd0e74cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e74d2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366119.476551:0:10475:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1736366119.476553:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013016768:0@lo:103:ldlm_bl_03.0 00010000:00010000:3.0:1736366119.476555:0:10475:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.102@tcp lock: ffff88008db6d8c0/0x98871c73fd0e74cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e74d2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366119.476558:0:10475:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.102@tcp lock: ffff88008db6d8c0/0x98871c73fd0e74cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x98871c73fd0e74d2 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366119.476563:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366119.476564:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1736366119.476564:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366119.476565:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366119.476572:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013016704:0@lo:103:ldlm_bl_02.0 00000100:00100000:2.0:1736366119.476575:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366119.476577:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366119.476578:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013016832:0@lo:103:ldlm_bl_04.0 00000100:00100000:2.0:1736366119.476589:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366119.476621:0:7256:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016640 00000100:00100000:3.0:1736366119.476627:0:8053:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016768 00010000:00010000:2.0:1736366119.476633:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366119.476646:0:7256:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016832 00000100:00100000:3.0:1736366119.476648:0:8053:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18008 00000100:00100000:3.0:1736366119.476650:0:8053:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+24:3326:x1820703013016640:12345-0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1736366119.476651:0:9269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18009 00000100:00100000:2.0:1736366119.476654:0:9269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab4c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+24:3324:x1820703013016768:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:3.0:1736366119.476655:0:8053:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1736366119.476660:0:7256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18010 00010000:00010000:2.0:1736366119.476660:0:9269:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1736366119.476661:0:8053:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88006ef19d40/0x98871c73fd0e74e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98871c73fd0e74d9 expref: 24 pid: 16273 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1736366119.476664:0:7256:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d209300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+24:3326:x1820703013016832:12345-0@lo:103:ldlm_bl_04.0 00010000:00010000:2.0:1736366119.476666:0:9269:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a8d98fc0/0x98871c73fd0e75a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98871c73fd0e759d expref: 23 pid: 16273 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366119.476666:0:8053:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1736366119.476671:0:7256:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1736366119.476672:0:9269:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1736366119.476677:0:7256:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88006fde0900/0x98871c73fd0e74d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98871c73fd0e74cb expref: 22 pid: 16271 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1736366119.476684:0:8053:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+21:3326:x1820703013016640:12345-0@lo:103:ldlm_bl_03.0 Request processed in 33us (120us total) trans 0 rc 0/0 00010000:00010000:0.0:1736366119.476685:0:7256:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1736366119.476688:0:9269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab4c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+21:3324:x1820703013016768:12345-0@lo:103:ldlm_bl_03.0 Request processed in 33us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366119.476688:0:8053:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18008 00000100:00100000:2.0:1736366119.476691:0:9269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18009 00000100:00100000:3.0:1736366119.476701:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366119.476709:0:7256:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d209300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+19:3326:x1820703013016832:12345-0@lo:103:ldlm_bl_04.0 Request processed in 45us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366119.476709:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013016832:0@lo:103:ldlm_bl_04.0 00000100:00100000:2.0:1736366119.476713:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2084c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013016640:0@lo:103:ldlm_bl_03.0 00000100:00100000:0.0:1736366119.476715:0:7256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18010 00000100:00100000:3.0:1736366119.476726:0:11343:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016704 00000100:00100000:0.0:1736366119.476739:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013016768:0@lo:103:ldlm_bl_03.0 00000100:00100000:3.0:1736366119.476739:0:11343:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18011 00000100:00100000:3.0:1736366119.476741:0:11343:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad3440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+19:3323:x1820703013016704:12345-0@lo:103:ldlm_bl_02.0 00010000:00010000:3.0:1736366119.476744:0:11343:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1736366119.476748:0:11343:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88006ef1a640/0x98871c73fd0e75d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98871c73fd0e75ce expref: 19 pid: 16269 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1736366119.476752:0:11343:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1736366119.476763:0:11343:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad3440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013016704:12345-0@lo:103:ldlm_bl_02.0 Request processed in 22us (62us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366119.476766:0:11343:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18011 00000100:00100000:2.0:1736366119.476865:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013016704:0@lo:103:ldlm_bl_02.0 00000004:00000080:1.0:1736366119.479046:0:17953:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x40086672 00000001:00080000:1.0:1736366119.479423:0:16265:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 541165879303 is committed 00010000:00010000:2.0:1736366119.479431:0:3309:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2880/0x98871c73fd0e7908 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479437:0:3309:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2880/0x98871c73fd0e7908 lrc: 2/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479441:0:3309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2880/0x98871c73fd0e7908 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479450:0:3309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006fde2880 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:2.0:1736366119.479452:0:3309:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2880/0x98871c73fd0e7908 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479456:0:3309:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2880/0x98871c73fd0e7908 lrc: 4/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479465:0:3309:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x174a82e8 (ffff8800b7b3cb00) 00010000:00010000:2.0:1736366119.479466:0:3309:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736366119.479468:0:3309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2880/0x98871c73fd0e7908 lrc: 2/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479470:0:3309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2880/0x98871c73fd0e7908 lrc: 0/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25656 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479480:0:3309:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1200/0x98871c73fd0e7940 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479483:0:3309:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1200/0x98871c73fd0e7940 lrc: 2/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479486:0:3309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1200/0x98871c73fd0e7940 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479488:0:3309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006fde1200 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:2.0:1736366119.479489:0:3309:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1200/0x98871c73fd0e7940 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479492:0:3309:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1200/0x98871c73fd0e7940 lrc: 4/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000020:00000080:0.0:1736366119.479496:0:17953:0:(obd_config.c:877:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/12 00010000:00010000:2.0:1736366119.479499:0:3309:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x174a82e8 (ffff8800b7b3cb00) 00010000:00010000:2.0:1736366119.479500:0:3309:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736366119.479501:0:3309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1200/0x98871c73fd0e7940 lrc: 2/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1736366119.479502:0:17953:0:(genops.c:1752:print_export_data()) lustre-MDT0000: ACTIVE ffff8800739e5000 cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 192.168.201.2@tcp 7 (0 0 1) 0 0 0 1: ffff880123c8e000 541165879303 stale:0 00010000:00010000:2.0:1736366119.479503:0:3309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde1200/0x98871c73fd0e7940 lrc: 0/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x174a82e8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1736366119.479507:0:17953:0:(genops.c:1752:print_export_data()) lustre-MDT0000: ACTIVE ffff8800739e2000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: (null) 0 stale:0 00010000:00010000:2.0:1736366119.479510:0:3309:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0240/0x98871c73fd0e7947 lrc: 3/0,1 mode: COS/COS res: [0x20003dc61:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1736366119.479511:0:17953:0:(genops.c:1752:print_export_data()) lustre-MDT0000: ACTIVE ffff88008b7e4000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: (null) 0 stale:0 00010000:00010000:2.0:1736366119.479513:0:3309:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0240/0x98871c73fd0e7947 lrc: 2/0,0 mode: COS/COS res: [0x20003dc61:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1736366119.479514:0:17953:0:(genops.c:1752:print_export_data()) lustre-MDT0000: ACTIVE ffff8800739e7800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: (null) 0 stale:0 00010000:00010000:2.0:1736366119.479516:0:3309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0240/0x98871c73fd0e7947 lrc: 3/0,0 mode: COS/COS res: [0x20003dc61:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1736366119.479518:0:17953:0:(genops.c:1752:print_export_data()) lustre-MDT0000: ACTIVE ffff88012c761800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: (null) 0 stale:0 00010000:00010000:2.0:1736366119.479518:0:3309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006fde0240 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:2.0:1736366119.479519:0:3309:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0240/0x98871c73fd0e7947 lrc: 3/0,0 mode: COS/COS res: [0x20003dc61:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1736366119.479521:0:17953:0:(genops.c:1752:print_export_data()) lustre-MDT0000: UNLINKED ffff88012c763800 cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 192.168.201.2@tcp 1 (0 0 0) 1 0 1 0: (null) 536870912003 stale:0 00010000:00010000:2.0:1736366119.479522:0:3309:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0240/0x98871c73fd0e7947 lrc: 4/0,0 mode: COS/COS res: [0x20003dc61:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1736366119.479525:0:17953:0:(genops.c:1525:class_disconnect_exports()) OBD device 5 (ffff8800963d3c90) has exports, disconnecting them 00010000:00010000:2.0:1736366119.479525:0:3309:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20003dc61:0x1:0x0].0x0 (ffff8800b7b3ce00) 00010000:00010000:2.0:1736366119.479526:0:3309:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1736366119.479527:0:3309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0240/0x98871c73fd0e7947 lrc: 2/0,0 mode: --/COS res: [0x20003dc61:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1736366119.479528:0:17953:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.2@tcp (ffff8800739e5000), last request at 1736366117 00000020:00000080:0.0:1736366119.479531:0:17953:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x98871c73fd0e7898 00000020:00010000:0.0:1736366119.479534:0:17953:0:(genops.c:1857:obd_stale_export_put()) Put export ffff8800739e5000: total 2 00010000:00010000:2.0:1736366119.479534:0:3309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde0240/0x98871c73fd0e7947 lrc: 0/0,0 mode: --/COS res: [0x20003dc61:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1736366119.479536:0:17953:0:(import.c:86:import_set_state_nolock()) ffff8800739e6000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:2.0:1736366119.479541:0:3309:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2d00/0x98871c73fd0e7978 lrc: 3/0,1 mode: COS/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479544:0:3309:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2d00/0x98871c73fd0e7978 lrc: 2/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479546:0:3309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2d00/0x98871c73fd0e7978 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00000020:00010000:1.0:1736366119.479547:0:14340:0:(genops.c:1843:obd_stale_export_get()) Get export ffff8800739e5000: total 2 00010000:00010000:1.0:1736366119.479548:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366119.479549:0:3309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88006fde2d00 already unused, calling callback (ffffffffa0ea0360) 00010000:00010000:2.0:1736366119.479550:0:3309:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2d00/0x98871c73fd0e7978 lrc: 3/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479552:0:3309:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2d00/0x98871c73fd0e7978 lrc: 4/0,0 mode: COS/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479556:0:3309:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7fda96f6 (ffff88008c46c000) 00010000:00010000:2.0:1736366119.479556:0:3309:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1736366119.479557:0:3309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2d00/0x98871c73fd0e7978 lrc: 2/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1736366119.479560:0:3309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde2d00/0x98871c73fd0e7978 lrc: 0/0,0 mode: --/COS res: [0x200000007:0x1:0x0].0x7fda96f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26348 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1736366119.479572:0:14340:0:(ldlm_lock.c:2634:ldlm_export_cancel_blocked_locks()) Export ffff8800739e5000, canceled 0 locks, left on hash table 1. 00000020:00080000:0.0:1736366119.479582:0:17953:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 192.168.201.2@tcp (ffff8800739e5000): rc 0 00000020:00080000:0.0:1736366119.479607:0:17953:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8800739e2000), last request at 1736366118 00000020:00000080:0.0:1736366119.479610:0:17953:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x98871c73fd0e76c3 00010000:00010000:1.0:1736366119.479610:0:14340:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006fde06c0/0x98871c73fd0e7916 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.2@tcp remote: 0x50df2825ebe24a22 expref: 2 pid: 25656 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1736366119.479612:0:17953:0:(import.c:86:import_set_state_nolock()) ffff8800739e7000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:1.0:1736366119.479620:0:14340:0:(ldlm_lock.c:2662:ldlm_export_cancel_locks()) Export ffff8800739e5000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1736366119.479623:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1736366119.479637:0:17953:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 0@lo (ffff8800739e2000): rc 0 00000020:00000080:0.0:1736366119.479639:0:17953:0:(genops.c:985:class_export_put()) final put ffff8800739e2000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1736366119.479644:0:17953:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88008b7e4000), last request at 1736366118 00000020:00000080:0.0:1736366119.479646:0:17953:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x98871c73fd0e76b5 00000020:00000080:2.0:1736366119.479649:0:30346:0:(genops.c:944:class_export_destroy()) destroying export ffff8800739e2000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00080000:0.0:1736366119.479663:0:17953:0:(import.c:86:import_set_state_nolock()) ffff88008b7e5800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:0.0:1736366119.479671:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1736366119.479684:0:30346:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff8800739e7000 for lustre-MDT0000 00000020:00080000:0.0:1736366119.479695:0:17953:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 0@lo (ffff88008b7e4000): rc 0 00000020:00000080:0.0:1736366119.479696:0:17953:0:(genops.c:985:class_export_put()) final put ffff88008b7e4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1736366119.479701:0:17953:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8800739e7800), last request at 1736366118 00000020:00000080:0.0:1736366119.479703:0:17953:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x98871c73fd0e76bc 00000020:00000080:2.0:1736366119.479704:0:30346:0:(genops.c:944:class_export_destroy()) destroying export ffff88008b7e4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:0.0:1736366119.479708:0:17953:0:(import.c:86:import_set_state_nolock()) ffff8800739e1000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000020:00000080:2.0:1736366119.479720:0:30346:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88008b7e5800 for lustre-MDT0000 00010000:00010000:3.0:1736366119.479726:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1736366119.479740:0:17953:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 0@lo (ffff8800739e7800): rc 0 00000020:00000080:0.0:1736366119.479741:0:17953:0:(genops.c:985:class_export_put()) final put ffff8800739e7800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1736366119.479746:0:17953:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88012c761800), last request at 1736366118 00000020:00000080:0.0:1736366119.479748:0:17953:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x98871c73fd0e751f 00000020:00000080:2.0:1736366119.479749:0:30346:0:(genops.c:944:class_export_destroy()) destroying export ffff8800739e7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1736366119.479751:0:17953:0:(import.c:86:import_set_state_nolock()) ffff88012c766000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000020:00000080:2.0:1736366119.479770:0:30346:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff8800739e1000 for lustre-MDT0000 00000020:00080000:0.0:1736366119.479771:0:17953:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 0@lo (ffff88012c761800): rc 0 00000020:00000080:0.0:1736366119.479772:0:17953:0:(genops.c:985:class_export_put()) final put ffff88012c761800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1736366119.479775:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1736366119.479780:0:30346:0:(genops.c:944:class_export_destroy()) destroying export ffff88012c761800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000100:00080000:0.0:1736366119.479794:0:17953:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1736366119.479796:0:17953:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:2.0:1736366119.479797:0:30346:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88012c766000 for lustre-MDT0000 00000100:00080000:0.0:1736366119.479799:0:17953:0:(pinger.c:414:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1736366119.479806:0:17953:0:(import.c:86:import_set_state_nolock()) ffff880123c86800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1736366119.479814:0:17953:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab2f80 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:17953:1820703013016896:0@lo:39:umount.0 00000100:00100000:0.0:1736366119.479837:0:17953:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366119.479849:0:17953:0:(client.c:2492:ptlrpc_set_wait()) set ffff88006ff0ee40 going to sleep for 5 seconds 00000100:00100000:2.0:1736366119.479854:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016896 00000100:00100000:2.0:1736366119.479874:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77052 00000100:00100000:2.0:1736366119.479877:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab0e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:17953:x1820703013016896:12345-0@lo:39:umount.0 00000020:00000080:2.0:1736366119.479888:0:24903:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x98871c73fd0e755e 00000100:00080000:2.0:1736366119.479891:0:24903:0:(import.c:86:import_set_state_nolock()) ffff880087e41000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:3.0:1736366119.479911:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1736366119.479915:0:24903:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 37, last_transno is 158913790019 00000100:00100000:2.0:1736366119.479995:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab0e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+2:17953:x1820703013016896:12345-0@lo:39:umount.0 Request processed in 118us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366119.479999:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77052 00000100:00100000:0.0:1736366119.480027:0:17953:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab2f80 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:17953:1820703013016896:0@lo:39:umount.0 00000100:00080000:0.0:1736366119.480036:0:17953:0:(import.c:86:import_set_state_nolock()) ffff880123c86800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1736366119.480038:0:17953:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1736366119.480039:0:17953:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1736366119.480041:0:17953:0:(import.c:339:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1736366119.482006:0:17953:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1736366119.482012:0:17953:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 81604380090 gen 3 00000004:00080000:0.0:1736366119.482037:0:17953:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00080000:0.0:1736366119.482039:0:17953:0:(pinger.c:414:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1736366119.482048:0:17953:0:(import.c:86:import_set_state_nolock()) ffff8800918c8800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1736366119.482055:0:17953:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab2f80 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:17953:1820703013016960:0@lo:9:umount.0 00000100:00100000:0.0:1736366119.482076:0:17953:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366119.482091:0:17953:0:(client.c:2492:ptlrpc_set_wait()) set ffff88006ff0ee40 going to sleep for 5 seconds 00000100:00100000:3.0:1736366119.482149:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013016960 00000100:00100000:3.0:1736366119.482191:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94692 00000100:00100000:3.0:1736366119.482199:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab63c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17953:x1820703013016960:12345-0@lo:9:umount.0 00000020:00000080:3.0:1736366119.482212:0:9254:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x98871c73fd0e7573 00000100:00080000:3.0:1736366119.482215:0:9254:0:(import.c:86:import_set_state_nolock()) ffff88009df8f800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:0.0:1736366119.482226:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1736366119.482229:0:9254:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 19, last_transno is 81604380090 00000100:00100000:3.0:1736366119.482287:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab63c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:17953:x1820703013016960:12345-0@lo:9:umount.0 Request processed in 88us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366119.482291:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94692 00000100:00100000:0.0:1736366119.482303:0:17953:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab2f80 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:17953:1820703013016960:0@lo:9:umount.0 00000100:00080000:0.0:1736366119.482310:0:17953:0:(import.c:86:import_set_state_nolock()) ffff8800918c8800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1736366119.482322:0:17953:0:(osp_dev.c:1590:osp_import_event()) got disconnected 00000004:00080000:0.0:1736366119.482323:0:17953:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00080000:0.0:1736366119.482324:0:17953:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1736366119.482325:0:17953:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 81604380090 gen 4 00000004:00080000:0.0:1736366119.482327:0:17953:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00100000:0.0:1736366119.482328:0:17953:0:(import.c:339:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1736366119.482450:0:17953:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1736366119.482452:0:17953:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 3 00000004:00080000:0.0:1736366119.482462:0:17953:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00080000:0.0:1736366119.482464:0:17953:0:(pinger.c:414:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1736366119.482472:0:17953:0:(import.c:86:import_set_state_nolock()) ffff8800959dc800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1736366119.482479:0:17953:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab2f80 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:17953:1820703013017024:0@lo:9:umount.0 00000100:00100000:0.0:1736366119.482498:0:17953:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366119.482513:0:17953:0:(client.c:2492:ptlrpc_set_wait()) set ffff88006ff0ee40 going to sleep for 5 seconds 00000100:00100000:3.0:1736366119.482526:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017024 00000100:00100000:3.0:1736366119.482537:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94693 00000100:00100000:3.0:1736366119.482539:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17953:x1820703013017024:12345-0@lo:9:umount.0 00000020:00000080:3.0:1736366119.482548:0:9254:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x98871c73fd0e7588 00000100:00080000:3.0:1736366119.482550:0:9254:0:(import.c:86:import_set_state_nolock()) ffff8800739e3000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:2.0:1736366119.482558:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1736366119.482560:0:9254:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589936057 00000100:00100000:3.0:1736366119.482619:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:17953:x1820703013017024:12345-0@lo:9:umount.0 Request processed in 79us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366119.482622:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94693 00000100:00100000:0.0:1736366119.482644:0:17953:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab2f80 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:17953:1820703013017024:0@lo:9:umount.0 00000100:00080000:0.0:1736366119.482651:0:17953:0:(import.c:86:import_set_state_nolock()) ffff8800959dc800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1736366119.482656:0:17953:0:(osp_dev.c:1590:osp_import_event()) got disconnected 00000004:00080000:0.0:1736366119.482657:0:17953:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00080000:0.0:1736366119.482663:0:17953:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1736366119.482664:0:17953:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 4 00000004:00080000:0.0:1736366119.482668:0:17953:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00100000:0.0:1736366119.482669:0:17953:0:(import.c:339:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00080000:0.0:1736366119.482821:0:17953:0:(genops.c:1530:class_disconnect_exports()) OBD device 5 (ffff8800963d3c90) has no exports 00000020:00080000:2.0:1736366119.482859:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880099a4ba80 refcount 1 committed 1 result 0 batchid 519691042848 00000020:00080000:2.0:1736366119.482863:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012a2f5a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482865:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x2:0x40011573:0x2].11 00000020:00080000:2.0:1736366119.482866:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b1986d00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482868:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x2:0x3bd20:0x2].11 00000020:00080000:2.0:1736366119.482873:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880099a49240 refcount 1 committed 1 result 0 batchid 519691042849 00000020:00080000:2.0:1736366119.482874:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131fd7a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482876:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].1 00000020:00080000:2.0:1736366119.482877:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012a2f5100 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482883:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x2:0x3bd20:0x2].12 00000020:00080000:2.0:1736366119.482886:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880099a493c0 refcount 1 committed 1 result 0 batchid 519691042850 00000020:00080000:2.0:1736366119.482887:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131fd7900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482889:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x2:0x40011573:0x2].12 00000020:00080000:2.0:1736366119.482889:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131fd7000 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482890:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3c4f0:0x2].1 00000020:00080000:2.0:1736366119.482892:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008417b240 refcount 1 committed 1 result 0 batchid 523986010136 00000020:00080000:2.0:1736366119.482893:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b1986c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482894:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].2 00000020:00080000:2.0:1736366119.482895:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131fd7400 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482896:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].1 00000020:00080000:2.0:1736366119.482898:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880099a4a480 refcount 1 committed 1 result 0 batchid 523986010137 00000020:00080000:2.0:1736366119.482900:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131fd7d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482901:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].3 00000020:00080000:2.0:1736366119.482902:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b1986700 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482903:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].2 00000020:00080000:2.0:1736366119.482905:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008921a9c0 refcount 1 committed 1 result 0 batchid 523986010138 00000020:00080000:2.0:1736366119.482906:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131fd7c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482907:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].4 00000020:00080000:2.0:1736366119.482908:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131fd7e00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482909:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].3 00000020:00080000:2.0:1736366119.482913:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009a5ded80 refcount 1 committed 1 result 0 batchid 523986010139 00000020:00080000:2.0:1736366119.482914:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800932c5400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482915:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].5 00000020:00080000:2.0:1736366119.482918:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131fd7700 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482919:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].4 00000020:00080000:2.0:1736366119.482922:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012b4cd840 refcount 1 committed 1 result 0 batchid 523986010140 00000020:00080000:2.0:1736366119.482923:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800932c5b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482925:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].6 00000020:00080000:2.0:1736366119.482925:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800932c5300 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482926:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].5 00000020:00080000:2.0:1736366119.482928:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012b4cd540 refcount 1 committed 1 result 0 batchid 523986010141 00000020:00080000:2.0:1736366119.482929:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800932c5500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482931:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].7 00000020:00080000:2.0:1736366119.482931:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800932c5d00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482932:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].6 00000020:00080000:2.0:1736366119.482936:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012b4cd000 refcount 1 committed 1 result 0 batchid 523986010142 00000020:00080000:2.0:1736366119.482937:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a5782900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482939:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].8 00000020:00080000:2.0:1736366119.482939:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800932c5000 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482941:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].7 00000020:00080000:2.0:1736366119.482945:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800b4e84300 refcount 1 committed 1 result 0 batchid 523986010143 00000020:00080000:2.0:1736366119.482946:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a5782600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482948:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].9 00000020:00080000:2.0:1736366119.482948:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a5782800 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482950:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].8 00000020:00080000:2.0:1736366119.482952:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800b4e840c0 refcount 1 committed 1 result 0 batchid 523986010144 00000020:00080000:2.0:1736366119.482953:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a5782c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482958:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].10 00000020:00080000:2.0:1736366119.482959:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a5782000 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482960:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].9 00000020:00080000:2.0:1736366119.482962:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009b3a0780 refcount 1 committed 1 result 0 batchid 523986010145 00000020:00080000:2.0:1736366119.482964:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a5782b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482965:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].11 00000020:00080000:2.0:1736366119.482966:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a5782700 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482967:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].10 00000020:00080000:2.0:1736366119.482968:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009b3a0840 refcount 1 committed 1 result 0 batchid 523986010146 00000020:00080000:2.0:1736366119.482969:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a5782400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482970:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].12 00000020:00080000:2.0:1736366119.482971:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a5782f00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482972:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].11 00000020:00080000:2.0:1736366119.482974:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009b3a0900 refcount 1 committed 1 result 0 batchid 523986010147 00000020:00080000:2.0:1736366119.482975:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a5782d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482976:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].13 00000020:00080000:2.0:1736366119.482977:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a5782500 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482978:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].12 00000020:00080000:2.0:1736366119.482979:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009f91a000 refcount 1 committed 1 result 0 batchid 523986010148 00000020:00080000:2.0:1736366119.482980:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a5782100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482981:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].14 00000020:00080000:2.0:1736366119.482982:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800a5782a00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482983:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].13 00000020:00080000:2.0:1736366119.482985:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009f91a9c0 refcount 1 committed 1 result 0 batchid 523986010149 00000020:00080000:2.0:1736366119.482989:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131491100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482990:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].16 00000020:00080000:2.0:1736366119.482991:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131491700 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482993:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].14 00000020:00080000:2.0:1736366119.482995:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880092c45d80 refcount 1 committed 1 result 0 batchid 523986010150 00000020:00080000:2.0:1736366119.482996:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131491600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482997:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].17 00000020:00080000:2.0:1736366119.482998:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131491e00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.482999:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].16 00000020:00080000:2.0:1736366119.483000:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880092c45a80 refcount 1 committed 1 result 0 batchid 523986010151 00000020:00080000:2.0:1736366119.483001:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131491d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.483003:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].18 00000020:00080000:2.0:1736366119.483003:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131491a00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.483005:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].17 00000020:00080000:2.0:1736366119.483007:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012c4249c0 refcount 1 committed 1 result 0 batchid 523986010152 00000020:00080000:2.0:1736366119.483008:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131491300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.483009:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].19 00000020:00080000:2.0:1736366119.483009:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880131491400 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.483011:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].18 00000020:00080000:2.0:1736366119.483016:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012c424f00 refcount 1 committed 1 result 0 batchid 523986010153 00000020:00080000:2.0:1736366119.483017:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b1d97000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.483018:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].20 00000020:00080000:2.0:1736366119.483019:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b1d97b00 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.483020:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].19 00000020:00080000:2.0:1736366119.483025:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012c424180 refcount 1 committed 1 result 0 batchid 523986010154 00000020:00080000:2.0:1736366119.483026:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b1d97400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.483027:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].21 00000020:00080000:2.0:1736366119.483028:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b1d97200 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.483029:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].20 00000020:00080000:2.0:1736366119.483031:0:16292:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009b175a80 refcount 1 committed 1 result 0 batchid 523986010155 00000020:00080000:2.0:1736366119.483032:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b1d97f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.483033:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x40011d41:0x2].22 00000020:00080000:2.0:1736366119.483034:0:16292:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b1d97800 obd lustre-MDT0000-osd committed 1 started 0 stopped 0 result 0 sub_th (null) 00000020:00080000:2.0:1736366119.483035:0:16292:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x1:0x3ccc0:0x2].21 00000100:00100000:2.0:1736366119.487248:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736366119.487256:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2084c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013017088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1736366119.487280:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366119.487298:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017088 00000100:00100000:2.0:1736366119.487315:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77053 00000100:00100000:2.0:1736366119.487318:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3325:x1820703013017088:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1736366119.487322:0:24903:0:(tgt_handler.c:780:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1736366119.487342:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3325:x1820703013017088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 23us (62us total) trans 0 rc -107/-107 00000100:00100000:2.0:1736366119.487345:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77053 00000100:02020000:3.0:1736366119.487362:0:3325:0:(client.c:1361:ptlrpc_check_status()) 11-0: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1736366119.487366:0:3325:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@192.168.201.102@tcp abruptly disconnected: reconnecting 00000100:00080000:3.0:1736366119.487368:0:3325:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1736366119.487369:0:3325:0:(import.c:200:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1736366119.491449:0:3325:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736366119.491452:0:3325:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8456 00000100:00080000:3.0:1736366119.491456:0:3325:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366119.491471:0:3325:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad2600 x1820703013017152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366119.491495:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013017152:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1736366119.491524:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366119.491545:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017152 00000100:00100000:3.0:1736366119.491556:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77054 00000100:00100000:3.0:1736366119.491559:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013017152:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1736366119.491568:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366119.491582:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013017152:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 23us (58us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366119.491585:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77054 00000100:00080000:3.0:1736366119.491610:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366119.491611:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366119.491613:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013017152:0@lo:38:ptlrpcd_00_02.0 00000020:00000080:1.0:1736366119.492557:0:14340:0:(genops.c:985:class_export_put()) final put ffff8800739e5000/cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 00010000:00010000:1.0:1736366119.492576:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366119.492577:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1736366119.492579:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1736366119.492589:0:30346:0:(genops.c:944:class_export_destroy()) destroying export ffff8800739e5000/cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b for lustre-MDT0000 00000020:00000080:2.0:1736366119.492639:0:30346:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff8800739e6000 for lustre-MDT0000 00010000:00010000:3.0:1736366119.747362:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366120.749442:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366121.487474:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013017216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366121.487626:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366121.487699:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017216 00000100:00100000:1.0:1736366121.487760:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5840 00000100:00100000:1.0:1736366121.487767:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab2f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013017216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1736366121.487799:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8657664 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736366121.487881:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab2f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013017216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366121.487923:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5840 00000100:00100000:0.0:1736366121.487949:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013017216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366121.503442:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013017280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366121.503484:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366121.503541:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017280 00000100:00100000:2.0:1736366121.503629:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5841 00000100:00100000:2.0:1736366121.503636:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd784c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013017280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366121.503665:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366121.503751:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd784c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013017280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366121.503762:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5841 00000100:00100000:1.0:1736366121.503784:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013017280:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736366121.751286:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366122.753373:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366123.520279:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366123.520351:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366123.520408:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366123.520422:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041012864 00000100:00100000:0.0:1736366123.520463:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366123.520469:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 846 00000100:00100000:3.0:1736366123.520476:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1875:x1820703041012864:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000020:00080000:3.0:1736366123.520487:0:26348:0:(tgt_handler.c:780:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.2@tcp 00000100:00100000:1.0:1736366123.520490:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041012800 00000100:00100000:0.0:1736366123.520512:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366123.520580:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041012928 00000100:00100000:3.0:1736366123.520588:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1875:x1820703041012864:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 111us (321us total) trans 0 rc -107/-107 00000100:00100000:3.0:1736366123.520596:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 846 00000100:00100000:1.0:1736366123.520602:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 163 00000100:00100000:1.0:1736366123.520609:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1874:x1820703041012800:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366123.520614:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 657 00000100:00100000:3.0:1736366123.520620:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041012928:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366123.520644:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041012992 00000100:00100000:3.0:1736366123.520654:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041012928:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 34us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366123.520656:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1874:x1820703041012800:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 47us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366123.520660:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 657 00000100:00100000:1.0:1736366123.520663:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 163 00000100:00100000:2.0:1736366123.520677:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013056 00000100:00100000:2.0:1736366123.520704:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 7189 00000100:00100000:2.0:1736366123.520712:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1875:x1820703041012992:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366123.520717:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 7190 00000100:00100000:1.0:1736366123.520722:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1874:x1820703041013056:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366123.520746:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1874:x1820703041013056:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 23us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366123.520752:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 7190 00000100:00100000:2.0:1736366123.520770:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1875:x1820703041012992:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 57us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366123.520781:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 7189 00000100:00100000:0.0:1736366123.522196:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366123.522283:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013120 00000100:00100000:3.0:1736366123.522328:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 847 00000100:00100000:3.0:1736366123.522334:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041013120:12345-192.168.201.2@tcp:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1736366123.522350:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366123.522397:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041013120:12345-192.168.201.2@tcp:38:ptlrpcd_00_01.0 Request processed in 63us (239us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366123.522405:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 847 00000100:00100000:2.0:1736366123.743416:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013017472:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366123.743423:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366123.743430:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366123.743433:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366123.743439:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8467 00000100:00080000:0.0:1736366123.743443:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366123.743449:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366123.743469:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13af80 x1820703013017664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366123.743478:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013017344:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366123.743496:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366123.743508:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013017664:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366123.743518:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3324:1820703013017536:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366123.743569:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013017792:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366123.743594:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366123.743594:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366123.743611:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366123.743624:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017472 00000100:00100000:2.0:1736366123.743640:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736366123.743648:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3323:1820703013017856:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366123.743660:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017536 00000100:00100000:0.0:1736366123.743664:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:3.0:1736366123.743664:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366123.743670:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013017472:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366123.743680:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366123.743685:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:1.0:1736366123.743689:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3324:x1820703013017536:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366123.743689:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017344 00000020:00080000:1.0:1736366123.743696:0:16831:0:(tgt_handler.c:780:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1736366123.743718:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1736366123.743719:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017664 00000100:00100000:3.0:1736366123.743723:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013017344:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366123.743728:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013017472:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366123.743729:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3324:x1820703013017536:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (136us total) trans 0 rc -107/-107 00000100:00100000:1.0:1736366123.743753:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1736366123.743753:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77055 00000100:00100000:3.0:1736366123.743754:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013017344:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366123.743760:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013017664:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366123.743761:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1736366123.743765:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1736366123.743770:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017856 00010000:02000000:2.0:1736366123.743779:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366123.743784:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:1.0:1736366123.743787:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3323:x1820703013017856:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366123.743790:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013017600:0@lo:400:kworker/u8:0.0 00000020:00080000:1.0:1736366123.743792:0:16831:0:(tgt_handler.c:780:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1736366123.743819:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013017472:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366123.743819:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366123.743823:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3323:x1820703013017856:12345-0@lo:400:kworker/u8:0.0 Request processed in 36us (145us total) trans 0 rc -107/-107 00000100:00100000:1.0:1736366123.743829:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:1.0:1736366123.743836:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017600 00000100:00080000:0.0:1736366123.743843:0:3323:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@192.168.201.102@tcp abruptly disconnected: reconnecting 00000100:00080000:0.0:1736366123.743846:0:3323:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1736366123.743849:0:3323:0:(import.c:200:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1736366123.743851:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013017664:12345-0@lo:38:kworker/u8:0.0 Request processed in 90us (257us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366123.743852:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00080000:0.0:1736366123.743853:0:3323:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1736366123.743854:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736366123.743855:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013017600:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366123.743856:0:3323:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8276 00000100:00080000:3.0:1736366123.743858:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00080000:0.0:1736366123.743860:0:3323:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366123.743862:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013017664:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366123.743873:0:3323:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13c280 x1820703013017920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366123.743877:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77055 00000100:00100000:1.0:1736366123.743881:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013017600:12345-0@lo:400:kworker/u8:0.0 Request processed in 25us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366123.743886:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:3.0:1736366123.743894:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013017344:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366123.743898:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3323:1820703013017856:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366123.743905:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013017920:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1736366123.743911:0:3324:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@192.168.201.102@tcp abruptly disconnected: reconnecting 00000100:00100000:2.0:1736366123.743914:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3326:1820703013017408:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366123.743915:0:3324:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1736366123.743918:0:3324:0:(import.c:200:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1736366123.743921:0:3324:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1736366123.743924:0:3324:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8276 00000100:00080000:1.0:1736366123.743928:0:3324:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366123.743939:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366123.743943:0:3324:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cd7cc00 x1820703013017984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366123.743955:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366123.743956:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3324:1820703013017536:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366123.743957:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017920 00000100:00100000:3.0:1736366123.743959:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013017984:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1736366123.743973:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017408 00000100:00100000:3.0:1736366123.743976:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366123.743978:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013017728:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366123.743985:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017984 00000100:00100000:0.0:1736366123.743994:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:0.0:1736366123.743998:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013017920:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1736366123.744000:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1736366123.744004:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013017600:0@lo:400:kworker/u8:0.0 00010000:02000000:0.0:1736366123.744008:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366123.744009:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366123.744012:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3326:x1820703013017408:12345-0@lo:400:kworker/u8:0.0 00000020:00080000:1.0:1736366123.744018:0:25656:0:(tgt_handler.c:780:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1736366123.744043:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013017920:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 44us (103us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366123.744051:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3326:x1820703013017408:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (96us total) trans 0 rc -107/-107 00000100:00100000:2.0:1736366123.744052:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:2.0:1736366123.744059:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013017984:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1736366123.744063:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366123.744064:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00080000:3.0:1736366123.744066:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366123.744067:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1736366123.744069:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013017920:0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1736366123.744071:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366123.744093:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017792 00000100:00100000:0.0:1736366123.744124:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013017728 00000100:00100000:2.0:1736366123.744129:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013017984:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 69us (150us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366123.744140:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:0.0:1736366123.744148:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7191 00000100:00100000:0.0:1736366123.744152:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013017792:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366123.744155:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7192 00000100:00100000:3.0:1736366123.744196:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013017728:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366123.744219:0:3326:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@192.168.201.102@tcp abruptly disconnected: reconnecting 00000100:00080000:2.0:1736366123.744224:0:3326:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1736366123.744229:0:3326:0:(import.c:200:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1736366123.744232:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013017792:12345-0@lo:400:kworker/u8:0.0 Request processed in 79us (622us total) trans 0 rc 0/0 00000100:00080000:2.0:1736366123.744233:0:3326:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736366123.744237:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013017728:12345-0@lo:400:kworker/u8:0.0 Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00080000:2.0:1736366123.744238:0:3326:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8276 00000100:00100000:0.0:1736366123.744239:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7191 00000100:00100000:3.0:1736366123.744243:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7192 00000100:00080000:2.0:1736366123.744244:0:3326:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366123.744250:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013017792:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366123.744266:0:3326:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d20e3c0 x1820703013018048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:3.0:1736366123.744279:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366123.744282:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366123.744283:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3326:1820703013017408:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366123.744285:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013017984:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1736366123.744299:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013018048:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1736366123.744302:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013017728:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366123.744318:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366123.744381:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018048 00000100:00100000:0.0:1736366123.744408:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:0.0:1736366123.744412:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013018048:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1736366123.744420:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366123.744458:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013018048:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 45us (139us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366123.744464:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00080000:3.0:1736366123.744492:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366123.744496:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366123.744499:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013018048:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1736366123.755338:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1736366124.608598:0:6088:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1736366124.608606:0:6088:0:(genops.c:985:class_export_put()) final put ffff880087e47800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1736366124.608611:0:21815:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1736366124.608614:0:21815:0:(genops.c:985:class_export_put()) final put ffff88009df8e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1736366124.608627:0:18180:0:(genops.c:944:class_export_destroy()) destroying export ffff880087e47800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:3.0:1736366124.608641:0:23400:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1736366124.608645:0:23400:0:(genops.c:985:class_export_put()) final put ffff88009df8e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1736366124.608695:0:18180:0:(genops.c:944:class_export_destroy()) destroying export ffff88009df8e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1736366124.608720:0:18180:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff880087e41000 for lustre-MDT0001 00000020:00000080:1.0:1736366124.608726:0:18180:0:(genops.c:944:class_export_destroy()) destroying export ffff88009df8e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1736366124.608743:0:18180:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff8800739e3000 for lustre-OST0001 00000020:00000080:1.0:1736366124.608747:0:18180:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88009df8f800 for lustre-OST0000 00010000:00010000:3.0:1736366124.757399:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366125.759302:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366126.495385:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013018112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366126.495439:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366126.495514:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018112 00000100:00100000:0.0:1736366126.495547:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5842 00000100:00100000:0.0:1736366126.495551:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013018112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366126.495572:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8657664 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366126.495601:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013018112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366126.495605:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5842 00000100:00100000:2.0:1736366126.495621:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013018112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366126.511419:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013018176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366126.511465:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366126.511583:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018176 00000100:00100000:0.0:1736366126.511606:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5843 00000100:00100000:0.0:1736366126.511609:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013018176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366126.511622:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366126.511649:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013018176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366126.511653:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5843 00000100:00100000:3.0:1736366126.511670:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013018176:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736366126.761552:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366127.763320:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366128.527798:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366128.527837:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366128.527859:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366128.527880:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366128.527900:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013312 00000100:00100000:0.0:1736366128.527905:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366128.527908:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013184 00000100:00100000:0.0:1736366128.527924:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013376 00000100:00100000:1.0:1736366128.527929:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013248 00000100:00100000:2.0:1736366128.527932:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013440 00000100:00100000:3.0:1736366128.527932:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 165 00000100:00100000:3.0:1736366128.527936:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041013184:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366128.527940:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 660 00000100:00100000:1.0:1736366128.527943:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041013312:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366128.527946:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 7193 00000100:00100000:0.0:1736366128.527951:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1875:x1820703041013376:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366128.527956:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 7194 00000100:00100000:2.0:1736366128.527959:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1874:x1820703041013440:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366128.527983:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041013312:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 39us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366128.527983:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041013184:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 46us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366128.527986:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1875:x1820703041013376:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 35us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366128.527989:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 660 00000100:00100000:3.0:1736366128.527989:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 165 00000100:00100000:2.0:1736366128.527990:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1874:x1820703041013440:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 31us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366128.527993:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 7193 00000100:00100000:2.0:1736366128.527995:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 7194 00000100:00100000:1.0:1736366128.527998:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 854 00000100:00100000:1.0:1736366128.528000:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041013248:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366128.528010:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366128.528022:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041013248:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 21us (118us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366128.528034:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 854 00000100:00080000:0.0:1736366128.751272:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366128.751277:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366128.751279:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366128.751284:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8471 00000100:00080000:0.0:1736366128.751288:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366128.751292:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366128.751304:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b138e40 x1820703013018304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366128.751320:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366128.751322:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366128.751322:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366128.751324:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8471 00000100:00080000:0.0:1736366128.751325:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366128.751326:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366128.751333:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13e880 x1820703013018432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366128.751340:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013018240:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366128.751348:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013018368:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366128.751359:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366128.751361:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366128.751361:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366128.751363:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8471 00000100:00080000:0.0:1736366128.751364:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366128.751366:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366128.751372:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13e3c0 x1820703013018560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366128.751382:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366128.751384:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366128.751384:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366128.751386:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8471 00000100:00080000:0.0:1736366128.751387:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366128.751388:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366128.751392:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13cc00 x1820703013018752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366128.751393:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366128.751394:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366128.751394:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b139c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013018624:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366128.751417:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013018688:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366128.751420:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366128.751421:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018240 00000100:00100000:2.0:1736366128.751425:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013018496:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366128.751460:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018368 00000100:00100000:2.0:1736366128.751465:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366128.751472:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013018304:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366128.751478:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018496 00000100:00100000:0.0:1736366128.751482:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1736366128.751486:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013018240:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366128.751486:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1736366128.751486:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366128.751489:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013018368:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366128.751493:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018624 00000100:00100000:3.0:1736366128.751494:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013018432:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366128.751505:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366128.751511:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013018560:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366128.751514:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7195 00000100:00100000:1.0:1736366128.751517:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013018368:12345-0@lo:400:kworker/u8:0.0 Request processed in 27us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366128.751518:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013018240:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366128.751518:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013018624:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366128.751521:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:0.0:1736366128.751522:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1736366128.751522:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366128.751528:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013018752:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366128.751529:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018304 00000100:00100000:1.0:1736366128.751532:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018432 00000100:00100000:1.0:1736366128.751536:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1736366128.751538:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095170980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013018496:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366128.751538:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366128.751541:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013018624:12345-0@lo:400:kworker/u8:0.0 Request processed in 24us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366128.751544:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7195 00000100:00100000:0.0:1736366128.751547:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018752 00000100:00100000:1.0:1736366128.751551:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095170980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013018496:12345-0@lo:400:kworker/u8:0.0 Request processed in 12us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366128.751553:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:1.0:1736366128.751556:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1736366128.751557:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013018304:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366128.751558:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018560 00000100:00100000:0.0:1736366128.751563:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:0.0:1736366128.751566:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013018432:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366128.751566:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00010000:02000000:3.0:1736366128.751566:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366128.751567:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013018752:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366128.751567:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77056 00000100:00100000:2.0:1736366128.751569:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad5580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013018560:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366128.751573:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366128.751574:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736366128.751575:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366128.751584:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013018304:12345-0@lo:38:kworker/u8:0.0 Request processed in 27us (98us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366128.751587:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013018752:12345-0@lo:38:kworker/u8:0.0 Request processed in 19us (49us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366128.751589:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad5580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013018560:12345-0@lo:38:kworker/u8:0.0 Request processed in 20us (67us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366128.751590:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:3.0:1736366128.751593:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:0.0:1736366128.751594:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013018432:12345-0@lo:38:kworker/u8:0.0 Request processed in 28us (89us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366128.751598:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:2.0:1736366128.751600:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77056 00000100:00100000:1.0:1736366128.751610:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013018496:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366128.751617:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b139c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013018624:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366128.751620:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013018368:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366128.751631:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736366128.751636:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366128.751638:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366128.751639:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018688 00000100:00100000:3.0:1736366128.751640:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013018304:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366128.751642:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013018240:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366128.751644:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366128.751645:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366128.751646:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013018432:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366128.751649:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7196 00000100:00080000:3.0:1736366128.751650:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366128.751651:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013018688:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366128.751651:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366128.751652:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013018560:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366128.751655:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366128.751656:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366128.751657:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013018752:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366128.751669:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013018688:12345-0@lo:400:kworker/u8:0.0 Request processed in 17us (38us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366128.751672:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7196 00000100:00100000:1.0:1736366128.751677:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013018688:0@lo:400:kworker/u8:0.0 00010000:00010000:1.0:1736366128.765293:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366129.767358:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366130.769325:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366131.503463:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800951763c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013018816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366131.503536:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366131.503614:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018816 00000100:00100000:2.0:1736366131.503668:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5844 00000100:00100000:2.0:1736366131.503675:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013018816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366131.503707:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8657664 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366131.503759:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013018816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366131.503767:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5844 00000100:00100000:0.0:1736366131.503788:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800951763c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013018816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366131.519446:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366131.519458:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013018880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366131.519487:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366131.519533:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018880 00000100:00100000:2.0:1736366131.519567:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5845 00000100:00100000:2.0:1736366131.519572:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013018880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366131.519594:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366131.519649:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013018880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366131.519656:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5845 00000100:00100000:0.0:1736366131.519712:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013018880:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736366131.771445:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366132.773442:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:0.0:1736366133.515271:0:17953:0:(genops.c:1786:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 4. Is it stuck? 00000020:02000400:0.0:1736366133.522035:0:17953:0:(genops.c:1752:print_export_data()) lustre-MDT0000: UNLINKED ffff88012c763800 cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 192.168.201.2@tcp 1 (0 0 0) 1 0 1 0: (null) 536870912003 stale:0 00000100:00100000:0.0:1736366133.536049:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366133.536091:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366133.536117:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366133.536140:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366133.536140:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013632 00000100:00100000:0.0:1736366133.536195:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366133.536209:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013504 00000100:00100000:3.0:1736366133.536213:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013696 00000100:00100000:1.0:1736366133.536218:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013568 00000100:00100000:0.0:1736366133.536232:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 663 00000100:00100000:0.0:1736366133.536240:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041013632:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366133.536240:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 858 00000100:00100000:1.0:1736366133.536246:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041013568:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366133.536252:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013760 00000100:00100000:2.0:1736366133.536259:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 167 00010000:02000000:1.0:1736366133.536262:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366133.536265:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041013504:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366133.536273:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 7197 00000100:00100000:3.0:1736366133.536279:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1875:x1820703041013696:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366133.536307:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041013632:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 68us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366133.536307:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041013568:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 61us (113us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366133.536315:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 858 00000100:00100000:2.0:1736366133.536318:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041013504:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 53us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366133.536325:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 663 00000100:00100000:2.0:1736366133.536326:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 167 00000100:00100000:3.0:1736366133.536335:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1875:x1820703041013696:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 55us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366133.536342:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 7197 00000100:00100000:0.0:1736366133.536393:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 7198 00000100:00100000:0.0:1736366133.536409:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1874:x1820703041013760:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366133.536444:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1874:x1820703041013760:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 36us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366133.536450:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 7198 00000100:00080000:0.0:1736366133.759313:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366133.759319:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366133.759323:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366133.759328:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8476 00000100:00080000:0.0:1736366133.759332:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366133.759337:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366133.759352:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13a600 x1820703013019008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366133.759447:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013018944:0@lo:400:kworker/u8:1.0 00000100:00080000:0.0:1736366133.759452:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366133.759456:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366133.759457:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366133.759460:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8476 00000100:00080000:0.0:1736366133.759462:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366133.759466:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366133.759468:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b139c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013019072:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366133.759476:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13bdc0 x1820703013019136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366133.759489:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366133.759492:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366133.759493:0:30346:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366133.759496:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8476 00000100:00080000:0.0:1736366133.759497:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366133.759510:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366133.759512:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366133.759521:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b139300 x1820703013019264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366133.759522:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366133.759537:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013019008:0@lo:38:kworker/u8:1.0 00000100:00080000:0.0:1736366133.759545:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366133.759548:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366133.759549:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366133.759552:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8476 00000100:00080000:0.0:1736366133.759553:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366133.759556:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366133.759560:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736366133.759563:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13c280 x1820703013019456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366133.759564:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013019392:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366133.759566:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013019200:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366133.759581:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366133.759591:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013019328:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366133.759604:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366133.759607:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013019136:0@lo:38:kworker/u8:1.0 00000100:00100000:0.0:1736366133.759608:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019072 00000100:00100000:1.0:1736366133.759616:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366133.759635:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019008 00000100:00100000:0.0:1736366133.759647:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019200 00000100:00100000:3.0:1736366133.759651:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366133.759661:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019136 00000100:00100000:0.0:1736366133.759663:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:2.0:1736366133.759664:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019392 00000100:00100000:0.0:1736366133.759668:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd79c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013019072:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366133.759676:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013019264:0@lo:38:kworker/u8:1.0 00000100:00100000:1.0:1736366133.759678:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1736366133.759683:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013019200:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366133.759689:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7199 00000100:00100000:2.0:1736366133.759694:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095174280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013019392:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366133.759713:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366133.759720:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd79c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013019072:12345-0@lo:400:kworker/u8:1.0 Request processed in 51us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366133.759726:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013019200:12345-0@lo:400:kworker/u8:1.0 Request processed in 43us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366133.759727:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1736366133.759732:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1736366133.759735:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013019456:0@lo:38:kworker/u8:1.0 00000100:00100000:2.0:1736366133.759739:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095174280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013019392:12345-0@lo:400:kworker/u8:1.0 Request processed in 44us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366133.759746:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:2.0:1736366133.759746:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7199 00000100:00100000:0.0:1736366133.759750:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013019008:12345-0@lo:38:kworker/u8:1.0 00010000:02000000:0.0:1736366133.759759:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366133.759763:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1736366133.759765:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366133.759767:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013019136:12345-0@lo:38:kworker/u8:1.0 00000100:00100000:2.0:1736366133.759767:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019264 00010000:02000000:1.0:1736366133.759777:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366133.759782:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77057 00000100:00100000:2.0:1736366133.759786:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013019264:12345-0@lo:38:kworker/u8:1.0 00010000:02000000:2.0:1736366133.759795:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736366133.759796:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366133.759798:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013019008:12345-0@lo:38:kworker/u8:1.0 Request processed in 47us (218us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736366133.759801:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366133.759803:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1736366133.759806:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013019008:0@lo:38:kworker/u8:1.0 00000100:00100000:0.0:1736366133.759813:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019456 00000100:00100000:1.0:1736366133.759813:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013019136:12345-0@lo:38:kworker/u8:1.0 Request processed in 46us (163us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366133.759819:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:2.0:1736366133.759821:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013019264:12345-0@lo:38:kworker/u8:1.0 Request processed in 35us (110us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736366133.759821:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366133.759824:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366133.759827:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77057 00000100:00100000:3.0:1736366133.759828:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013019136:0@lo:38:kworker/u8:1.0 00000100:00100000:0.0:1736366133.759841:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:0.0:1736366133.759844:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013019456:12345-0@lo:38:kworker/u8:1.0 00010000:02000000:0.0:1736366133.759851:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366133.759857:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013019392:0@lo:400:kworker/u8:1.0 00000100:00080000:3.0:1736366133.759861:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736366133.759863:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013019200:0@lo:400:kworker/u8:1.0 00000100:00080000:3.0:1736366133.759865:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366133.759868:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013019264:0@lo:38:kworker/u8:1.0 00000100:00100000:1.0:1736366133.759873:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b139c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013019072:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366133.759874:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013019456:12345-0@lo:38:kworker/u8:1.0 Request processed in 29us (111us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366133.759880:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00080000:3.0:1736366133.759881:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366133.759884:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366133.759888:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013019456:0@lo:38:kworker/u8:1.0 00000100:00100000:0.0:1736366133.759898:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013018944 00000100:00100000:1.0:1736366133.759901:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366133.759916:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1736366133.759920:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013018944:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366133.759928:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019328 00000100:00100000:0.0:1736366133.759945:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013018944:12345-0@lo:400:kworker/u8:1.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366133.759949:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7200 00000100:00100000:0.0:1736366133.759951:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1736366133.759962:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013019328:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366133.759985:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013018944:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366133.760016:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013019328:12345-0@lo:400:kworker/u8:1.0 Request processed in 54us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366133.760022:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7200 00000100:00100000:1.0:1736366133.760058:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013019328:0@lo:400:kworker/u8:1.0 00010000:00010000:1.0:1736366133.775416:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366134.777410:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366135.779483:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366136.511459:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736366136.511485:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013019520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366136.511556:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366136.511629:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019520 00000100:00100000:0.0:1736366136.511683:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5846 00000100:00100000:0.0:1736366136.511688:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951763c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013019520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366136.511721:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8657664 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366136.511770:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951763c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013019520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366136.511777:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5846 00000100:00100000:2.0:1736366136.511797:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013019520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366136.527411:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013019584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366136.527452:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366136.527524:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019584 00000100:00100000:0.0:1736366136.527572:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5847 00000100:00100000:0.0:1736366136.527580:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c8980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013019584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366136.527607:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366136.527657:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c8980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013019584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366136.527667:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5847 00000100:00100000:2.0:1736366136.527674:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013019584:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1736366136.781453:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366137.783429:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366138.544369:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366138.544412:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366138.544448:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366138.544476:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013952 00000100:00100000:0.0:1736366138.544477:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366138.544513:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013888 00000100:00100000:0.0:1736366138.544516:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366138.544535:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 666 00000100:00100000:1.0:1736366138.544542:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041013952:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366138.544543:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014016 00000100:00100000:2.0:1736366138.544561:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 862 00000100:00100000:2.0:1736366138.544567:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041013888:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:0.0:1736366138.544572:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014080 00000100:00100000:3.0:1736366138.544579:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041013824 00010000:02000000:2.0:1736366138.544585:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366138.544590:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 94694 00000100:00100000:0.0:1736366138.544596:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1873:x1820703041014016:12345-192.168.201.2@tcp:9:kworker/u8:0.0 00000100:00100000:3.0:1736366138.544621:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 169 00000100:00100000:1.0:1736366138.544622:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041013952:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 81us (262us total) trans 0 rc 0/0 00000020:00000080:0.0:1736366138.544623:0:24520:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x98871c73fd0e5e82 00000100:00100000:3.0:1736366138.544628:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041013824:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00080000:0.0:1736366138.544630:0:24520:0:(import.c:86:import_set_state_nolock()) ffff880094275800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000100:00100000:1.0:1736366138.544630:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 666 00000100:00100000:2.0:1736366138.544633:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041013888:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 66us (221us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366138.544641:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 862 00010000:00010000:1.0:1736366138.544658:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1736366138.544667:0:24520:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 19, last_transno is 81604380090 00000100:00100000:3.0:1736366138.544669:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041013824:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 41us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366138.544670:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 94695 00000100:00100000:2.0:1736366138.544676:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+5:1873:x1820703041014080:12345-192.168.201.2@tcp:9:kworker/u8:0.0 00000100:00100000:3.0:1736366138.544676:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 169 00000020:00000080:2.0:1736366138.544694:0:24517:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x98871c73fd0e78ad 00000100:00080000:2.0:1736366138.544699:0:24517:0:(import.c:86:import_set_state_nolock()) ffff880086b67000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:3.0:1736366138.544724:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1736366138.544736:0:24517:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589936057 00000100:00100000:0.0:1736366138.544802:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+2:1873:x1820703041014016:12345-192.168.201.2@tcp:9:kworker/u8:0.0 Request processed in 205us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366138.544810:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 94694 00000100:00100000:2.0:1736366138.544872:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+2:1873:x1820703041014080:12345-192.168.201.2@tcp:9:kworker/u8:0.0 Request processed in 195us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366138.544880:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 94695 00000100:00080000:0.0:1736366138.767336:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366138.767342:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366138.767344:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366138.767350:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8481 00000100:00080000:0.0:1736366138.767354:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366138.767359:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366138.767375:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13c280 x1820703013019712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366138.767404:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736366138.767405:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1736366138.767407:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366138.767409:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366138.767421:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8481 00000100:00080000:0.0:1736366138.767423:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00100000:3.0:1736366138.767425:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013019776:0@lo:400:kworker/u8:1.0 00000100:00080000:0.0:1736366138.767427:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366138.767437:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b139c80 x1820703013019840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366138.767459:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366138.767462:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1736366138.767462:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013019712:0@lo:38:kworker/u8:1.0 00000100:00080000:0.0:1736366138.767463:0:30346:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366138.767466:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8481 00000100:00080000:0.0:1736366138.767467:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366138.767470:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366138.767472:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013019904:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366138.767472:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366138.767479:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b1384c0 x1820703013019968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366138.767496:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013019648:0@lo:400:kworker/u8:1.0 00000100:00080000:0.0:1736366138.767501:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366138.767504:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366138.767505:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366138.767508:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8481 00000100:00100000:2.0:1736366138.767508:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366138.767510:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366138.767512:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366138.767520:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013020096:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366138.767521:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366138.767522:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b6d580 x1820703013020160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366138.767548:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b139c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013019840:0@lo:38:kworker/u8:1.0 00000100:00100000:1.0:1736366138.767557:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366138.767559:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013020032:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366138.767563:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019776 00000100:00100000:2.0:1736366138.767569:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366138.767587:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013019968:0@lo:38:kworker/u8:1.0 00000100:00100000:3.0:1736366138.767590:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019712 00000100:00100000:0.0:1736366138.767597:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366138.767597:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366138.767604:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019840 00000100:00100000:2.0:1736366138.767608:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366138.767610:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019904 00000100:00100000:2.0:1736366138.767619:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013020160:0@lo:38:kworker/u8:1.0 00000100:00100000:3.0:1736366138.767620:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:3.0:1736366138.767624:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013019776:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366138.767627:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1736366138.767633:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013019904:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366138.767634:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1736366138.767635:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366138.767639:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013019712:12345-0@lo:38:kworker/u8:1.0 00010000:02000000:0.0:1736366138.767657:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366138.767660:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019968 00000100:00100000:3.0:1736366138.767662:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013019776:12345-0@lo:400:kworker/u8:1.0 Request processed in 37us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366138.767668:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1736366138.767679:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77058 00000100:00100000:3.0:1736366138.767681:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020160 00000100:00100000:2.0:1736366138.767684:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013019968:12345-0@lo:38:kworker/u8:1.0 00000100:00100000:3.0:1736366138.767689:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1736366138.767692:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9caf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013019840:12345-0@lo:38:kworker/u8:1.0 00000100:00100000:1.0:1736366138.767694:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013019904:12345-0@lo:400:kworker/u8:1.0 Request processed in 61us (99us total) trans 0 rc 0/0 00010000:02000000:2.0:1736366138.767694:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366138.767697:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013019712:12345-0@lo:38:kworker/u8:1.0 Request processed in 57us (190us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366138.767701:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00010000:02000000:3.0:1736366138.767702:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366138.767705:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:1.0:1736366138.767721:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:2.0:1736366138.767721:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013019968:12345-0@lo:38:kworker/u8:1.0 Request processed in 36us (112us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366138.767725:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9ced40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013020160:12345-0@lo:38:kworker/u8:1.0 00000100:00100000:3.0:1736366138.767726:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9caf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013019840:12345-0@lo:38:kworker/u8:1.0 Request processed in 32us (157us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366138.767728:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77058 00010000:02000000:1.0:1736366138.767734:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366138.767742:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:0.0:1736366138.767743:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020096 00000100:00100000:2.0:1736366138.767750:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020032 00000100:00100000:1.0:1736366138.767755:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9ced40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013020160:12345-0@lo:38:kworker/u8:1.0 Request processed in 29us (120us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366138.767760:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:3.0:1736366138.767766:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013019648 00000100:00100000:0.0:1736366138.767767:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7201 00000100:00100000:0.0:1736366138.767771:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013020096:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366138.767771:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7202 00000100:00100000:2.0:1736366138.767775:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013020032:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366138.767783:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1736366138.767787:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013019648:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366138.767790:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013019904:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366138.767812:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013020096:12345-0@lo:400:kworker/u8:1.0 Request processed in 41us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366138.767814:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013020032:12345-0@lo:400:kworker/u8:1.0 Request processed in 38us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366138.767820:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7201 00000100:00100000:3.0:1736366138.767820:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013019648:12345-0@lo:400:kworker/u8:1.0 Request processed in 32us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366138.767823:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013020096:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366138.767826:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1736366138.767833:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7202 00000100:00080000:0.0:1736366138.767854:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366138.767857:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366138.767857:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013019776:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366138.767860:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013019968:0@lo:38:kworker/u8:1.0 00000100:00100000:1.0:1736366138.767860:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013020032:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366138.767866:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013019648:0@lo:400:kworker/u8:1.0 00000100:00080000:0.0:1736366138.767870:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366138.767872:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366138.767875:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013020160:0@lo:38:kworker/u8:1.0 00000100:00080000:0.0:1736366138.767917:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366138.767919:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366138.767922:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013019712:0@lo:38:kworker/u8:1.0 00000100:00080000:0.0:1736366138.767929:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366138.767931:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366138.767933:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b139c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013019840:0@lo:38:kworker/u8:1.0 00010000:00010000:3.0:1736366138.785414:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366139.787408:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366140.789487:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366141.519460:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9ca140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013020224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366141.519542:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366141.519684:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020224 00000100:00100000:0.0:1736366141.519743:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5848 00000100:00100000:0.0:1736366141.519761:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad17c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013020224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366141.519804:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366141.519885:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad17c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013020224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366141.519897:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5848 00000100:00100000:3.0:1736366141.519927:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9ca140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013020224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366141.535394:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9c84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013020288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366141.535435:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366141.535464:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020288 00000100:00100000:0.0:1736366141.535511:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5849 00000100:00100000:0.0:1736366141.535516:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd797c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013020288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366141.535538:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366141.535590:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd797c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013020288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366141.535597:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5849 00000100:00100000:1.0:1736366141.535634:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9c84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013020288:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366141.791406:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366142.793394:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366143.552107:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366143.552154:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366143.552274:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014272 00000100:00100000:0.0:1736366143.552277:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366143.552290:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014144 00000100:00100000:3.0:1736366143.552326:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014208 00000100:00100000:2.0:1736366143.552333:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 171 00000100:00100000:2.0:1736366143.552341:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041014144:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366143.552342:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 669 00000100:00100000:3.0:1736366143.552348:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041014272:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366143.552381:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 866 00000100:00100000:0.0:1736366143.552387:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041014208:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:0.0:1736366143.552404:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366143.552414:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041014144:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 74us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366143.552414:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041014272:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 65us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366143.552422:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 171 00000100:00100000:3.0:1736366143.552422:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 669 00000100:00100000:0.0:1736366143.552438:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041014208:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 51us (163us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366143.552445:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 866 00000001:00100000:0.0:1736366143.616444:0:23400:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 00000020:00000080:0.0:1736366143.616451:0:23400:0:(genops.c:985:class_export_put()) final put ffff880094277800/cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 00000001:00100000:1.0:1736366143.616483:0:21815:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 00000020:00000080:1.0:1736366143.616489:0:21815:0:(genops.c:985:class_export_put()) final put ffff880086b65000/cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 00000020:00000080:2.0:1736366143.616576:0:30346:0:(genops.c:944:class_export_destroy()) destroying export ffff880094277800/cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b for lustre-OST0000 00000020:00000080:2.0:1736366143.616642:0:30346:0:(genops.c:944:class_export_destroy()) destroying export ffff880086b65000/cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b for lustre-OST0001 00000020:00000080:2.0:1736366143.616661:0:30346:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff880094275800 for lustre-OST0000 00000020:00000080:2.0:1736366143.616666:0:30346:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff880086b67000 for lustre-OST0001 00000100:00080000:0.0:1736366143.775361:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366143.775369:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366143.775383:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366143.775390:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8486 00000100:00080000:0.0:1736366143.775396:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366143.775403:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366143.775417:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013020352:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366143.775429:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b6f6c0 x1820703013020416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366143.775475:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366143.775480:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013020416:0@lo:38:kworker/u8:1.0 00000100:00080000:0.0:1736366143.775481:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366143.775486:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366143.775488:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366143.775493:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8486 00000100:00080000:0.0:1736366143.775496:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366143.775500:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366143.775514:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b697c0 x1820703013020544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366143.775519:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020352 00000100:00100000:1.0:1736366143.775526:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366143.775531:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013020480:0@lo:400:kworker/u8:1.0 00000100:00080000:0.0:1736366143.775537:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366143.775541:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366143.775543:0:30346:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366143.775547:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8486 00000100:00100000:2.0:1736366143.775547:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1736366143.775550:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1736366143.775552:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013020352:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366143.775553:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b697c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013020544:0@lo:38:kworker/u8:1.0 00000100:00080000:0.0:1736366143.775554:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366143.775567:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b6da40 x1820703013020672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366143.775574:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366143.775588:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013020352:12345-0@lo:400:kworker/u8:1.0 Request processed in 36us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366143.775595:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1736366143.775600:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020416 00000100:00080000:0.0:1736366143.775605:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366143.775610:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366143.775612:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736366143.775612:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1736366143.775617:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8486 00000100:00100000:3.0:1736366143.775619:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b68980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013020608:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366143.775622:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020480 00000100:00100000:2.0:1736366143.775622:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013020800:0@lo:400:kworker/u8:1.0 00000100:00080000:0.0:1736366143.775628:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366143.775633:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366143.775643:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366143.775647:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366143.775648:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b6df00 x1820703013020864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366143.775663:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020608 00000100:00100000:2.0:1736366143.775671:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013020352:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366143.775680:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013020736:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366143.775682:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1736366143.775688:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013020480:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366143.775688:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1736366143.775694:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013020608:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366143.775695:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020800 00000100:00100000:2.0:1736366143.775714:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7203 00000100:00100000:2.0:1736366143.775717:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cb900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013020800:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366143.775726:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366143.775736:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013020480:12345-0@lo:400:kworker/u8:1.0 Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366143.775737:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013020608:12345-0@lo:400:kworker/u8:1.0 Request processed in 44us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366143.775743:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1736366143.775746:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:1.0:1736366143.775758:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:1.0:1736366143.775762:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013020416:12345-0@lo:38:kworker/u8:1.0 00000100:00100000:2.0:1736366143.775763:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cb900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013020800:12345-0@lo:400:kworker/u8:1.0 Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366143.775770:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7203 00010000:02000000:1.0:1736366143.775772:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366143.775778:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020736 00000100:00100000:3.0:1736366143.775780:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b68980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013020608:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366143.775789:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013020480:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366143.775794:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013020416:12345-0@lo:38:kworker/u8:1.0 Request processed in 31us (269us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366143.775800:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1736366143.775801:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013020800:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366143.775813:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7204 00000100:00100000:1.0:1736366143.775816:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366143.775821:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013020736:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366143.775829:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020544 00000100:00080000:1.0:1736366143.775837:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366143.775840:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366143.775843:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013020416:0@lo:38:kworker/u8:1.0 00000100:00100000:3.0:1736366143.775848:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:3.0:1736366143.775851:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013020544:12345-0@lo:38:kworker/u8:1.0 00000100:00100000:1.0:1736366143.775858:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013020672:0@lo:38:kworker/u8:1.0 00010000:02000000:3.0:1736366143.775861:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366143.775877:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013020736:12345-0@lo:400:kworker/u8:1.0 Request processed in 55us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366143.775883:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366143.775887:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7204 00000100:00100000:3.0:1736366143.775887:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013020544:12345-0@lo:38:kworker/u8:1.0 Request processed in 35us (71us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366143.775893:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1736366143.775910:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013020864:0@lo:38:kworker/u8:1.0 00000100:00100000:2.0:1736366143.775913:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020672 00000100:00100000:1.0:1736366143.775928:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366143.775936:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013020736:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366143.775941:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77059 00000100:00100000:2.0:1736366143.775945:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013020672:12345-0@lo:38:kworker/u8:1.0 00000100:00080000:1.0:1736366143.775946:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366143.775948:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366143.775951:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b697c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013020544:0@lo:38:kworker/u8:1.0 00000100:00100000:3.0:1736366143.775953:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020864 00010000:02000000:2.0:1736366143.775955:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366143.775967:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:3.0:1736366143.775970:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013020864:12345-0@lo:38:kworker/u8:1.0 00010000:02000000:3.0:1736366143.775977:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366143.775985:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013020672:12345-0@lo:38:kworker/u8:1.0 Request processed in 39us (102us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366143.775991:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77059 00000100:00100000:3.0:1736366143.775998:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013020864:12345-0@lo:38:kworker/u8:1.0 Request processed in 27us (69us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366143.776003:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366143.776004:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00080000:1.0:1736366143.776005:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366143.776016:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013020672:0@lo:38:kworker/u8:1.0 00000100:00080000:1.0:1736366143.776027:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366143.776029:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366143.776031:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013020864:0@lo:38:kworker/u8:1.0 00010000:00010000:3.0:1736366143.795365:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366144.797369:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366145.799433:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366146.527360:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736366146.527384:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013020928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366146.527454:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366146.527522:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020928 00000100:00100000:0.0:1736366146.527583:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5850 00000100:00100000:0.0:1736366146.527589:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013020928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366146.527621:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366146.527684:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013020928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366146.527692:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5850 00000100:00100000:2.0:1736366146.527720:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013020928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366146.543425:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736366146.543441:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9c9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013020992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366146.543482:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366146.543513:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013020992 00000100:00100000:0.0:1736366146.543561:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5851 00000100:00100000:0.0:1736366146.543568:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd78980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013020992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366146.543597:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366146.543660:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd78980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013020992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366146.543682:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5851 00000100:00100000:1.0:1736366146.543694:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9c9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013020992:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366146.801346:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366147.803369:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366148.560286:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366148.560335:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366148.560391:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014336 00000100:00100000:0.0:1736366148.560426:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366148.560452:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 173 00000100:00100000:3.0:1736366148.560459:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041014336:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366148.560461:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014464 00000100:00100000:0.0:1736366148.560476:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014400 00000100:00100000:1.0:1736366148.560506:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 672 00000100:00100000:0.0:1736366148.560512:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 870 00000100:00100000:1.0:1736366148.560512:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041014464:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366148.560518:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b68e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041014400:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366148.560531:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041014336:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 72us (254us total) trans 0 rc 0/0 00010000:02000000:0.0:1736366148.560534:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366148.560539:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 173 00000100:00100000:1.0:1736366148.560559:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041014464:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 47us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366148.560567:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 672 00000100:00100000:0.0:1736366148.560575:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b68e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041014400:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 56us (149us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366148.560582:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 870 00000100:00080000:0.0:1736366148.783306:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366148.783313:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366148.783316:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366148.783322:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8491 00000100:00080000:0.0:1736366148.783326:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366148.783331:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366148.783349:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b6f200 x1820703013021120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366148.783367:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013021056:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366148.783380:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366148.783383:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366148.783384:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366148.783387:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8491 00000100:00080000:0.0:1736366148.783389:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366148.783392:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366148.783408:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b69300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013021184:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366148.783415:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b6b900 x1820703013021248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366148.783427:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366148.783436:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366148.783439:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366148.783440:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366148.783443:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8491 00000100:00080000:0.0:1736366148.783445:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366148.783448:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366148.783449:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013021120:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366148.783457:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b6e3c0 x1820703013021376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366148.783460:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366148.783479:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366148.783482:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366148.783483:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366148.783486:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8491 00000100:00100000:3.0:1736366148.783486:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1736366148.783488:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1736366148.783489:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021056 00000100:00080000:0.0:1736366148.783490:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366148.783492:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013021504:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366148.783499:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b6df00 x1820703013021568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366148.783505:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366148.783515:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366148.783518:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1736366148.783521:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013021440:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366148.783524:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013021056:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366148.783533:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013021248:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366148.783545:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021504 00000100:00100000:0.0:1736366148.783560:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366148.783566:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013021056:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366148.783568:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366148.783573:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1736366148.783582:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021440 00000100:00100000:3.0:1736366148.783598:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7205 00000100:00100000:0.0:1736366148.783602:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736366148.783603:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013021504:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366148.783607:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013021376:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366148.783608:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013021312:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366148.783631:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013021056:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366148.783633:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366148.783649:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013021504:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366148.783650:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366148.783655:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7205 00000100:00100000:2.0:1736366148.783656:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021184 00000100:00100000:0.0:1736366148.783663:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7206 00000100:00100000:1.0:1736366148.783668:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013021568:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366148.783669:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013021440:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366148.783677:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021120 00000100:00100000:3.0:1736366148.783681:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021248 00000100:00100000:2.0:1736366148.783689:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021312 00000100:00100000:3.0:1736366148.783693:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:1.0:1736366148.783695:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366148.783697:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013021184:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366148.783701:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:2.0:1736366148.783704:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b697c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013021312:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366148.783727:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013021440:12345-0@lo:400:kworker/u8:0.0 Request processed in 58us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366148.783727:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013021184:12345-0@lo:400:kworker/u8:0.0 Request processed in 29us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366148.783733:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7206 00000100:00100000:3.0:1736366148.783733:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:2.0:1736366148.783739:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b697c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013021312:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366148.783744:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021568 00000100:00100000:2.0:1736366148.783745:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:3.0:1736366148.783753:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:3.0:1736366148.783767:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013021120:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366148.783772:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013021312:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366148.783775:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00010000:02000000:3.0:1736366148.783779:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366148.783781:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013021440:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366148.783781:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:1.0:1736366148.783783:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013021248:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366148.783785:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013021568:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366148.783795:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736366148.783798:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366148.783813:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013021120:12345-0@lo:38:kworker/u8:0.0 Request processed in 46us (311us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366148.783819:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1736366148.783822:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013021568:12345-0@lo:38:kworker/u8:0.0 Request processed in 37us (129us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366148.783823:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021376 00000100:00100000:2.0:1736366148.783828:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:1.0:1736366148.783839:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013021248:12345-0@lo:38:kworker/u8:0.0 Request processed in 56us (272us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366148.783842:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77060 00000100:00100000:0.0:1736366148.783846:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b139c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013021376:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366148.783850:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00010000:02000000:0.0:1736366148.783855:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366148.783865:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013021504:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366148.783875:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b69300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013021184:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366148.783884:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b139c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013021376:12345-0@lo:38:kworker/u8:0.0 Request processed in 37us (237us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366148.783890:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77060 00000100:00080000:1.0:1736366148.783891:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366148.783895:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366148.783901:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013021376:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366148.783915:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366148.783918:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366148.783922:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013021568:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366148.783935:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366148.783938:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366148.783941:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013021120:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366148.783952:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366148.783955:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366148.783959:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013021248:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366148.805363:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:0.0:1736366149.528340:0:17953:0:(genops.c:1786:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 16 seconds. The obd refcount = 4. Is it stuck? 00000020:02000400:0.0:1736366149.535534:0:17953:0:(genops.c:1752:print_export_data()) lustre-MDT0000: UNLINKED ffff88012c763800 cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 192.168.201.2@tcp 1 (0 0 0) 1 0 1 0: (null) 536870912003 stale:0 00010000:00010000:2.0:1736366149.807398:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366150.809434:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366151.535418:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013021632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366151.535489:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366151.535557:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021632 00000100:00100000:0.0:1736366151.535617:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5852 00000100:00100000:0.0:1736366151.535624:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013021632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366151.535658:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366151.535719:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013021632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366151.535727:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5852 00000100:00100000:3.0:1736366151.535767:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013021632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366151.551363:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366151.551381:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013021696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366151.551419:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366151.551484:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021696 00000100:00100000:2.0:1736366151.551533:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5853 00000100:00100000:2.0:1736366151.551539:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013021696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366151.551562:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366151.551610:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013021696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366151.551618:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5853 00000100:00100000:0.0:1736366151.551631:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013021696:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366151.811445:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366152.813400:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366153.568261:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366153.568303:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366153.568343:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366153.568384:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014656 00000100:00100000:3.0:1736366153.568385:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014528 00000100:00100000:2.0:1736366153.568392:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014592 00000100:00100000:2.0:1736366153.568433:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 675 00000100:00100000:3.0:1736366153.568434:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 175 00000100:00100000:0.0:1736366153.568439:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 874 00000100:00100000:2.0:1736366153.568441:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041014656:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366153.568442:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041014528:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366153.568445:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041014592:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:0.0:1736366153.568462:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366153.568528:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041014528:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 87us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366153.568533:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041014592:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 87us (190us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366153.568535:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041014656:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 93us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366153.568537:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 175 00000100:00100000:0.0:1736366153.568540:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 874 00000100:00100000:2.0:1736366153.568547:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 675 00000100:00080000:0.0:1736366153.791323:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366153.791329:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366153.791333:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366153.791338:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8496 00000100:00080000:0.0:1736366153.791341:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366153.791346:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366153.791363:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b684c0 x1820703013021824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366153.791395:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736366153.791395:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013021760:0@lo:400:kworker/u8:1.0 00000100:00080000:0.0:1736366153.791399:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366153.791401:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366153.791404:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8496 00000100:00080000:0.0:1736366153.791405:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366153.791408:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366153.791416:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b6cc00 x1820703013021952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366153.791422:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013021824:0@lo:38:kworker/u8:1.0 00000100:00080000:0.0:1736366153.791443:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366153.791446:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1736366153.791446:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366153.791447:0:30346:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366153.791450:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8496 00000100:00080000:0.0:1736366153.791452:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366153.791455:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366153.791467:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b6f200 x1820703013022080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366153.791470:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366153.791480:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013022016:0@lo:400:kworker/u8:1.0 00000100:00080000:0.0:1736366153.791500:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736366153.791501:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021760 00000100:00080000:0.0:1736366153.791503:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736366153.791503:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013021952:0@lo:38:kworker/u8:1.0 00000100:00080000:0.0:1736366153.791504:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366153.791507:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8496 00000100:00080000:0.0:1736366153.791509:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366153.791511:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366153.791519:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b69300 x1820703013022272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366153.791528:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1736366153.791532:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013021760:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366153.791536:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366153.791544:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b68980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013021888:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366153.791548:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013022144:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366153.791573:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013021760:12345-0@lo:400:kworker/u8:1.0 Request processed in 41us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366153.791580:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1736366153.791585:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366153.791598:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366153.791607:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013022208:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366153.791615:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021824 00000100:00100000:0.0:1736366153.791623:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022016 00000100:00100000:2.0:1736366153.791628:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366153.791634:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366153.791645:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021888 00000100:00100000:1.0:1736366153.791647:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013022080:0@lo:38:kworker/u8:1.0 00000100:00100000:0.0:1736366153.791649:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013021952 00000100:00100000:2.0:1736366153.791657:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013021760:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366153.791659:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1736366153.791664:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880133143dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013022016:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366153.791667:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366153.791671:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1736366153.791679:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013021888:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366153.791680:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b69300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013022272:0@lo:38:kworker/u8:1.0 00000100:00100000:2.0:1736366153.791681:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:2.0:1736366153.791684:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b138e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013021824:12345-0@lo:38:kworker/u8:1.0 00010000:02000000:2.0:1736366153.791694:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366153.791700:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880133143dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013022016:12345-0@lo:400:kworker/u8:1.0 Request processed in 36us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366153.791700:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366153.791707:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1736366153.791719:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b138e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013021824:12345-0@lo:38:kworker/u8:1.0 Request processed in 34us (251us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366153.791725:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022272 00000100:00100000:2.0:1736366153.791725:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1736366153.791734:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:0.0:1736366153.791737:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013021952:12345-0@lo:38:kworker/u8:1.0 00000100:00100000:2.0:1736366153.791740:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:2.0:1736366153.791743:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013022272:12345-0@lo:38:kworker/u8:1.0 00010000:02000000:0.0:1736366153.791747:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366153.791750:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366153.791752:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022080 00000100:00100000:3.0:1736366153.791757:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013021888:12345-0@lo:400:kworker/u8:1.0 Request processed in 77us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366153.791765:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:1.0:1736366153.791767:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77061 00000100:00100000:2.0:1736366153.791767:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013022272:12345-0@lo:38:kworker/u8:1.0 Request processed in 23us (68us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366153.791772:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013021952:12345-0@lo:38:kworker/u8:1.0 Request processed in 34us (138us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366153.791772:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013022080:12345-0@lo:38:kworker/u8:1.0 00000100:00100000:0.0:1736366153.791778:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00010000:02000000:1.0:1736366153.791783:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366153.791783:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:0.0:1736366153.791798:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022208 00000100:00100000:3.0:1736366153.791799:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022144 00000100:00100000:1.0:1736366153.791807:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013022080:12345-0@lo:38:kworker/u8:1.0 Request processed in 35us (140us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366153.791814:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77061 00000100:00100000:0.0:1736366153.791818:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7207 00000100:00100000:0.0:1736366153.791822:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9ca600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013022208:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366153.791825:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b68980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013021888:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366153.791830:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7208 00000100:00100000:3.0:1736366153.791836:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b139300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013022144:12345-0@lo:400:kworker/u8:1.0 00000100:00080000:1.0:1736366153.791841:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366153.791844:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366153.791848:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b69300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013022272:0@lo:38:kworker/u8:1.0 00000100:00100000:0.0:1736366153.791850:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9ca600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013022208:12345-0@lo:400:kworker/u8:1.0 Request processed in 28us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366153.791856:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7207 00000100:00080000:1.0:1736366153.791857:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366153.791859:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366153.791862:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013021952:0@lo:38:kworker/u8:1.0 00000100:00100000:2.0:1736366153.791863:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013022208:0@lo:400:kworker/u8:1.0 00000100:00080000:1.0:1736366153.791869:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366153.791871:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366153.791873:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013022080:0@lo:38:kworker/u8:1.0 00000100:00080000:1.0:1736366153.791881:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366153.791890:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366153.791890:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b139300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013022144:12345-0@lo:400:kworker/u8:1.0 Request processed in 51us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366153.791893:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013021824:0@lo:38:kworker/u8:1.0 00000100:00100000:3.0:1736366153.791900:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7208 00000100:00100000:1.0:1736366153.791932:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013022144:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366153.791938:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013022016:0@lo:400:kworker/u8:1.0 00010000:00010000:3.0:1736366153.815349:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366154.817339:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366155.819408:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366156.543438:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880133141c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013022336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366156.543510:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366156.543592:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022336 00000100:00100000:0.0:1736366156.543659:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5854 00000100:00100000:0.0:1736366156.543665:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cf6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013022336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366156.543697:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366156.543757:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cf6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013022336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366156.543765:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5854 00000100:00100000:2.0:1736366156.543779:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880133141c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013022336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366156.559379:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736366156.559399:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013022400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366156.559453:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366156.559526:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022400 00000100:00100000:0.0:1736366156.559566:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5855 00000100:00100000:0.0:1736366156.559571:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880133142ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013022400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366156.559593:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366156.559642:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880133142ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013022400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366156.559648:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5855 00000100:00100000:3.0:1736366156.559713:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013022400:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366156.821417:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366157.823418:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366158.576288:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366158.576340:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366158.576402:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014720 00000100:00100000:0.0:1736366158.576434:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366158.576467:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 177 00000100:00100000:2.0:1736366158.576477:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014848 00000100:00100000:3.0:1736366158.576478:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1874:x1820703041014720:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366158.576519:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014784 00000100:00100000:2.0:1736366158.576549:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 678 00000100:00100000:2.0:1736366158.576555:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041014848:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366158.576564:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 878 00000100:00100000:3.0:1736366158.576564:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1874:x1820703041014720:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 86us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366158.576575:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041014784:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366158.576576:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 177 00010000:02000000:1.0:1736366158.576597:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366158.576604:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041014848:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 48us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366158.576611:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 678 00000100:00100000:1.0:1736366158.576647:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041014784:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 72us (211us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366158.576659:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 878 00000100:00080000:0.0:1736366158.799319:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366158.799325:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366158.799328:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366158.799334:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8501 00000100:00080000:0.0:1736366158.799337:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366158.799343:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366158.799359:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b684c0 x1820703013022528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366158.799386:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366158.799389:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366158.799390:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366158.799393:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8501 00000100:00080000:0.0:1736366158.799395:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366158.799398:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366158.799405:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b6cc00 x1820703013022656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366158.799413:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013022464:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366158.799426:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736366158.799427:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013022592:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366158.799429:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366158.799430:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366158.799433:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8501 00000100:00080000:0.0:1736366158.799434:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366158.799437:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366158.799445:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099b6e3c0 x1820703013022784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366158.799473:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366158.799478:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366158.799480:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736366158.799480:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013022528:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366158.799481:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736366158.799482:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366158.799485:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8501 00000100:00080000:0.0:1736366158.799486:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366158.799489:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366158.799499:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d676c0 x1820703013022976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366158.799504:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013022912:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366158.799527:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366158.799529:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366158.799535:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b69300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013022720:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366158.799546:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022592 00000100:00100000:1.0:1736366158.799551:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013022656:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366158.799554:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b68980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013022848:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366158.799560:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366158.799574:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366158.799580:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022528 00000100:00100000:1.0:1736366158.799592:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022720 00000100:00100000:0.0:1736366158.799595:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:0.0:1736366158.799600:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880133142600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013022592:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366158.799609:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:2.0:1736366158.799613:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1384c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013022528:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366158.799619:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1736366158.799625:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880133141c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013022720:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:2.0:1736366158.799635:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366158.799636:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366158.799648:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880133142600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013022592:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366158.799650:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013022784:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366158.799655:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:3.0:1736366158.799664:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880133141c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013022720:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366158.799670:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1736366158.799672:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1384c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013022528:12345-0@lo:38:kworker/u8:0.0 Request processed in 58us (145us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366158.799674:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022656 00000100:00100000:1.0:1736366158.799676:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366158.799680:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:3.0:1736366158.799690:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:1.0:1736366158.799691:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013022976:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366158.799694:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013022656:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366158.799705:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022912 00010000:02000000:3.0:1736366158.799705:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366158.799707:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366158.799715:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022464 00000100:00100000:0.0:1736366158.799722:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022848 00000100:00080000:1.0:1736366158.799729:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366158.799732:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366158.799735:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7209 00000100:00100000:1.0:1736366158.799736:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013022528:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366158.799739:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013022912:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366158.799739:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1736366158.799740:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013022656:12345-0@lo:38:kworker/u8:0.0 Request processed in 43us (102us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366158.799743:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013022464:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366158.799744:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366158.799746:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366158.799750:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:1.0:1736366158.799758:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013022656:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366158.799769:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013022912:12345-0@lo:400:kworker/u8:0.0 Request processed in 30us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366158.799770:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022976 00000100:00100000:2.0:1736366158.799773:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013022464:12345-0@lo:400:kworker/u8:0.0 Request processed in 29us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366158.799775:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7209 00000100:00100000:2.0:1736366158.799779:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1736366158.799785:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7210 00000100:00100000:0.0:1736366158.799788:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9caac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013022848:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366158.799792:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013022784 00000100:00100000:3.0:1736366158.799795:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:3.0:1736366158.799801:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013022976:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366158.799811:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77062 00010000:02000000:3.0:1736366158.799811:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366158.799815:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013022784:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366158.799820:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013022912:0@lo:400:kworker/u8:0.0 00010000:02000000:1.0:1736366158.799825:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366158.799827:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9caac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013022848:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366158.799829:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013022464:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366158.799833:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7210 00000100:00100000:2.0:1736366158.799855:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b68980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013022848:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366158.799855:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013022976:12345-0@lo:38:kworker/u8:0.0 Request processed in 52us (146us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366158.799857:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013022784:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (180us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366158.799863:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77062 00000100:00100000:3.0:1736366158.799865:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00080000:1.0:1736366158.799890:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366158.799892:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366158.799895:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013022976:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366158.799903:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366158.799905:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366158.799906:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013022592:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366158.799907:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013022784:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366158.799985:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b69300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013022720:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366158.825366:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366159.827390:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366160.829396:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366161.551440:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cb440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013023040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366161.551512:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366161.551590:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023040 00000100:00100000:0.0:1736366161.551648:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5856 00000100:00100000:0.0:1736366161.551654:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013023040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366161.551686:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366161.551747:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013023040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366161.551755:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5856 00000100:00100000:3.0:1736366161.551798:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cb440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013023040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366161.567420:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013023104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366161.567461:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366161.567519:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023104 00000100:00100000:2.0:1736366161.567566:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5857 00000100:00100000:2.0:1736366161.567571:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d650c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013023104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366161.567594:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366161.567653:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d650c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013023104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366161.567660:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5857 00000100:00100000:0.0:1736366161.567702:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0d9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013023104:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366161.831378:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366162.833404:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366163.584299:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366163.584373:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366163.584442:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366163.584454:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014912 00000100:00100000:1.0:1736366163.584500:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015040 00000100:00100000:2.0:1736366163.584508:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 179 00000100:00100000:2.0:1736366163.584515:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041014912:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366163.584531:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041014976 00000100:00100000:1.0:1736366163.584557:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 681 00000100:00100000:1.0:1736366163.584563:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d60980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041015040:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366163.584568:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 882 00000100:00100000:3.0:1736366163.584574:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d62140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041014976:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366163.584590:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366163.584602:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041014912:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 87us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366163.584613:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 179 00000100:00100000:1.0:1736366163.584614:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d60980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041015040:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 48us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366163.584621:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 681 00000100:00100000:3.0:1736366163.584628:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d62140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041014976:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 54us (190us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366163.584636:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 882 00000100:00080000:0.0:1736366163.807307:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366163.807313:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366163.807317:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366163.807324:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8506 00000100:00080000:0.0:1736366163.807328:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366163.807333:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366163.807352:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d60000 x1820703013023232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366163.807385:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366163.807399:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366163.807400:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366163.807404:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8506 00000100:00080000:0.0:1736366163.807406:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00100000:2.0:1736366163.807406:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013023168:0@lo:400:kworker/u8:1.0 00000100:00080000:0.0:1736366163.807409:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366163.807420:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d60e40 x1820703013023360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366163.807422:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013023232:0@lo:38:kworker/u8:1.0 00000100:00080000:0.0:1736366163.807435:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366163.807437:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366163.807438:0:30346:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366163.807441:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8506 00000100:00080000:0.0:1736366163.807442:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366163.807445:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366163.807453:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d604c0 x1820703013023488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366163.807465:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366163.807465:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013023424:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366163.807467:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366163.807474:0:30346:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366163.807477:0:30346:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366163.807478:0:30346:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366163.807481:0:30346:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8506 00000100:00080000:0.0:1736366163.807482:0:30346:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366163.807485:0:30346:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366163.807492:0:30346:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d63dc0 x1820703013023680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366163.807507:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013023616:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366163.807509:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013023360:0@lo:38:kworker/u8:1.0 00000100:00100000:0.0:1736366163.807517:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013023296:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366163.807519:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366163.807534:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366163.807554:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736366163.807555:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366163.807560:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d63900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013023552:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366163.807574:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013023488:0@lo:38:kworker/u8:1.0 00000100:00100000:0.0:1736366163.807575:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023232 00000100:00100000:3.0:1736366163.807578:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023424 00000100:00100000:2.0:1736366163.807579:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366163.807596:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366163.807606:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023360 00000100:00100000:1.0:1736366163.807607:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013023680:0@lo:38:kworker/u8:1.0 00000100:00100000:2.0:1736366163.807607:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023616 00000100:00100000:3.0:1736366163.807620:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1736366163.807621:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366163.807629:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0da600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013023424:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366163.807632:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:2.0:1736366163.807632:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023552 00000100:00100000:0.0:1736366163.807637:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013023232:12345-0@lo:38:kworker/u8:1.0 00000100:00100000:1.0:1736366163.807646:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023488 00000100:00100000:2.0:1736366163.807647:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7211 00010000:02000000:0.0:1736366163.807649:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366163.807652:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013023616:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1736366163.807667:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77063 00000100:00100000:1.0:1736366163.807672:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c2140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013023488:12345-0@lo:38:kworker/u8:1.0 00010000:02000000:1.0:1736366163.807682:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366163.807712:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013023616:12345-0@lo:400:kworker/u8:1.0 Request processed in 58us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366163.807714:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013023232:12345-0@lo:38:kworker/u8:1.0 Request processed in 76us (247us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366163.807714:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0da600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013023424:12345-0@lo:400:kworker/u8:1.0 Request processed in 83us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366163.807720:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7211 00000100:00100000:0.0:1736366163.807721:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:1.0:1736366163.807724:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c2140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013023488:12345-0@lo:38:kworker/u8:1.0 Request processed in 51us (127us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366163.807726:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1736366163.807731:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77063 00000100:00100000:2.0:1736366163.807733:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7212 00000100:00100000:2.0:1736366163.807736:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013023552:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1736366163.807738:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023680 00000100:00100000:0.0:1736366163.807747:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1736366163.807750:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013023360:12345-0@lo:38:kworker/u8:1.0 00000100:00100000:3.0:1736366163.807752:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00010000:02000000:0.0:1736366163.807758:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366163.807758:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013023680:12345-0@lo:38:kworker/u8:1.0 00000100:00100000:2.0:1736366163.807760:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013023552:12345-0@lo:400:kworker/u8:1.0 Request processed in 23us (182us total) trans 0 rc 0/0 00000100:00080000:1.0:1736366163.807766:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366163.807766:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7212 00000100:00080000:1.0:1736366163.807769:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00010000:02000000:3.0:1736366163.807772:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366163.807774:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013023488:0@lo:38:kworker/u8:1.0 00000100:00100000:0.0:1736366163.807776:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013023360:12345-0@lo:38:kworker/u8:1.0 Request processed in 25us (223us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366163.807782:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00080000:1.0:1736366163.807783:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366163.807785:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366163.807788:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013023232:0@lo:38:kworker/u8:1.0 00000100:00100000:2.0:1736366163.807788:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023168 00000100:00100000:2.0:1736366163.807805:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00080000:1.0:1736366163.807806:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366163.807808:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366163.807812:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013023360:0@lo:38:kworker/u8:1.0 00000100:00100000:2.0:1736366163.807812:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013023168:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366163.807812:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013023680:12345-0@lo:38:kworker/u8:1.0 Request processed in 51us (187us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366163.807813:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736366163.807819:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366163.807821:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366163.807823:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013023680:0@lo:38:kworker/u8:1.0 00000100:00100000:3.0:1736366163.807823:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:0.0:1736366163.807840:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023296 00000100:00100000:2.0:1736366163.807851:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013023168:12345-0@lo:400:kworker/u8:1.0 Request processed in 41us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366163.807891:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1736366163.807915:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1736366163.807923:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d66d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013023296:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366163.807930:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d63900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013023552:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366163.807939:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013023616:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1736366163.807946:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013023168:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366163.808013:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d66d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013023296:12345-0@lo:400:kworker/u8:1.0 Request processed in 89us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366163.808024:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:0.0:1736366163.808054:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013023296:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1736366163.808073:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013023424:0@lo:400:kworker/u8:1.0 00010000:00010000:3.0:1736366163.835352:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366164.837350:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366165.839413:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366166.559444:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0daac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013023744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366166.559513:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366166.559580:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023744 00000100:00100000:2.0:1736366166.559640:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5858 00000100:00100000:2.0:1736366166.559647:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d66880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013023744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366166.559680:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366166.559734:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d66880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013023744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366166.559742:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5858 00000100:00100000:0.0:1736366166.559761:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0daac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013023744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366166.575395:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013023808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366166.575438:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366166.575504:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023808 00000100:00100000:0.0:1736366166.575554:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5859 00000100:00100000:0.0:1736366166.575559:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013023808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366166.575582:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366166.575622:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013023808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366166.575642:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013023808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366166.575643:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5859 00010000:00010000:1.0:1736366166.841407:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366167.843378:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366168.592084:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366168.592132:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366168.592211:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366168.592226:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015104 00000100:00100000:3.0:1736366168.592254:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015232 00000100:00100000:2.0:1736366168.592278:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 181 00000100:00100000:2.0:1736366168.592285:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041015104:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366168.592291:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015168 00000100:00100000:3.0:1736366168.592311:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 684 00000100:00100000:3.0:1736366168.592318:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d617c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041015232:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366168.592337:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 886 00000100:00100000:1.0:1736366168.592343:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041015168:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:2.0:1736366168.592357:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041015104:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 73us (282us total) trans 0 rc 0/0 00010000:02000000:1.0:1736366168.592359:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366168.592365:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d617c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041015232:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 47us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366168.592373:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 684 00000100:00100000:2.0:1736366168.592382:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 181 00000100:00100000:1.0:1736366168.592396:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041015168:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 53us (186us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366168.592404:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 886 00000100:00080000:0.0:1736366168.815321:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366168.815327:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366168.815330:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366168.815337:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8511 00000100:00080000:0.0:1736366168.815342:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366168.815347:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366168.815364:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d663c0 x1820703013023936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366168.815385:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366168.815388:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366168.815389:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366168.815392:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8511 00000100:00080000:0.0:1736366168.815393:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366168.815396:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366168.815403:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d62600 x1820703013024064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366168.815424:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013023872:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366168.815433:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366168.815436:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366168.815437:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366168.815440:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8511 00000100:00080000:0.0:1736366168.815442:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1736366168.815442:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013024000:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366168.815457:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366168.815469:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d62f80 x1820703013024192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366168.815487:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366168.815489:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366168.815490:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366168.815492:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366168.815494:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366168.815496:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8511 00000100:00080000:0.0:1736366168.815498:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366168.815501:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366168.815508:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d65f00 x1820703013024384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366168.815520:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013024320:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366168.815534:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013024128:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366168.815538:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024000 00000100:00100000:3.0:1736366168.815542:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d64c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013024256:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366168.815543:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366168.815569:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013023936:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366168.815569:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1736366168.815570:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366168.815575:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9ce3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013024000:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366168.815592:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366168.815592:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366168.815606:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013024064:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366168.815611:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024128 00000100:00100000:2.0:1736366168.815622:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9ce3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013024000:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366168.815625:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366168.815629:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1736366168.815635:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023936 00000100:00100000:1.0:1736366168.815638:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d62f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013024192:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366168.815638:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013023872 00000100:00100000:2.0:1736366168.815643:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024064 00000100:00100000:0.0:1736366168.815645:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1736366168.815649:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d64740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013024128:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366168.815653:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1736366168.815655:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366168.815656:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013023936:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366168.815664:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013024384:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366168.815667:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00010000:02000000:2.0:1736366168.815669:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366168.815672:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013023872:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366168.815680:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366168.815683:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d64740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013024128:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366168.815689:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1736366168.815697:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013023936:12345-0@lo:38:kworker/u8:0.0 Request processed in 40us (105us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366168.815703:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366168.815703:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00080000:1.0:1736366168.815706:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366168.815707:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024384 00000100:00100000:1.0:1736366168.815710:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013023936:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366168.815711:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013023872:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366168.815715:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:3.0:1736366168.815718:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1736366168.815719:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1736366168.815720:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013024064:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366168.815723:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013024384:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366168.815728:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736366168.815730:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366168.815737:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024320 00000100:00100000:3.0:1736366168.815753:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013023872:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366168.815754:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013024384:12345-0@lo:38:kworker/u8:0.0 Request processed in 29us (72us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366168.815755:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013024064:12345-0@lo:38:kworker/u8:0.0 Request processed in 34us (129us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366168.815760:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:2.0:1736366168.815817:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024256 00000100:00100000:1.0:1736366168.815825:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7213 00000100:00100000:1.0:1736366168.815830:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013024320:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366168.815836:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7214 00000100:00100000:3.0:1736366168.815841:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0db440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013024256:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366168.815867:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013024000:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366168.815876:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013024320:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366168.815878:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0db440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013024256:12345-0@lo:400:kworker/u8:0.0 Request processed in 37us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366168.815884:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7213 00000100:00100000:0.0:1736366168.815886:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:3.0:1736366168.815895:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7214 00000100:00100000:1.0:1736366168.815911:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024192 00000100:00100000:1.0:1736366168.815925:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77064 00000100:00100000:0.0:1736366168.815928:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013024128:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366168.815929:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013024192:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366168.815929:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d64c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013024256:0@lo:400:kworker/u8:0.0 00010000:02000000:1.0:1736366168.815938:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366168.815954:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013024320:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366168.815959:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013024192:12345-0@lo:38:kworker/u8:0.0 Request processed in 29us (303us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366168.815964:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77064 00000100:00080000:1.0:1736366168.815985:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366168.815987:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366168.815990:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013024064:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366168.815998:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366168.816000:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366168.816002:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d62f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013024192:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366168.816008:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366168.816010:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366168.816012:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013024384:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366168.845419:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366169.847407:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366170.849401:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366171.567441:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736366171.567474:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013024448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366171.567558:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366171.567636:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024448 00000100:00100000:0.0:1736366171.567688:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5860 00000100:00100000:0.0:1736366171.567695:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013024448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366171.567764:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366171.567823:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013024448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366171.567831:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5860 00000100:00100000:3.0:1736366171.567893:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013024448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366171.583453:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013024512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366171.583493:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366171.583557:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024512 00000100:00100000:2.0:1736366171.583601:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5861 00000100:00100000:2.0:1736366171.583607:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d61c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013024512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366171.583630:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366171.583676:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d61c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013024512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366171.583683:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5861 00000100:00100000:0.0:1736366171.583696:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013024512:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366171.851450:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366172.853375:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366173.599977:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366173.600024:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366173.600064:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366173.600070:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015296 00000100:00100000:2.0:1736366173.600132:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 183 00000100:00100000:2.0:1736366173.600142:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041015296:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366173.600146:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015424 00000100:00100000:3.0:1736366173.600151:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015360 00000100:00100000:1.0:1736366173.600245:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 687 00000100:00100000:1.0:1736366173.600252:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d63900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041015424:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366173.600256:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 890 00000100:00100000:3.0:1736366173.600262:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d63dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041015360:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366173.600279:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366173.600284:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041015296:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 143us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366173.600296:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 183 00000100:00100000:1.0:1736366173.600310:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d63900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041015424:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 58us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366173.600321:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 687 00000100:00100000:3.0:1736366173.600321:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d63dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041015360:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 58us (256us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366173.600329:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 890 00000100:00080000:0.0:1736366173.823323:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366173.823330:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366173.823333:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366173.823340:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8516 00000100:00080000:0.0:1736366173.823343:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366173.823348:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366173.823366:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d60000 x1820703013024640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366173.823397:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366173.823410:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366173.823412:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366173.823415:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8516 00000100:00080000:0.0:1736366173.823417:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366173.823420:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366173.823421:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013024576:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366173.823431:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d676c0 x1820703013024768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366173.823437:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013024640:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366173.823442:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1736366173.823447:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366173.823450:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366173.823451:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366173.823454:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8516 00000100:00080000:0.0:1736366173.823456:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366173.823459:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366173.823459:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013024832:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366173.823469:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d65f00 x1820703013024896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366173.823475:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366173.823486:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366173.823489:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366173.823490:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366173.823491:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366173.823493:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8516 00000100:00080000:0.0:1736366173.823495:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366173.823497:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366173.823503:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013025024:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366173.823504:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d61300 x1820703013025088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366173.823521:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366173.823528:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013024768:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366173.823528:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366173.823536:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d62f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013024960:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366173.823544:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013024704:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366173.823556:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366173.823559:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025024 00000100:00100000:2.0:1736366173.823574:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366173.823576:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013024896:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366173.823577:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366173.823586:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7215 00000100:00100000:3.0:1736366173.823591:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013025024:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366173.823610:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024960 00000100:00100000:1.0:1736366173.823623:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366173.823629:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013025024:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366173.823638:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024640 00000100:00100000:1.0:1736366173.823642:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013025088:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366173.823643:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7216 00000100:00100000:2.0:1736366173.823650:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d64c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013024960:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366173.823659:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024832 00000100:00100000:3.0:1736366173.823660:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7215 00000100:00100000:1.0:1736366173.823670:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366173.823676:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024768 00000100:00100000:0.0:1736366173.823683:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024704 00000100:00100000:1.0:1736366173.823739:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024896 00000100:00100000:1.0:1736366173.823768:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77065 00000100:00100000:1.0:1736366173.823776:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013024896:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366173.823776:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013025024:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366173.823779:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d64c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013024960:12345-0@lo:400:kworker/u8:0.0 Request processed in 128us (202us total) trans 0 rc 0/0 00010000:02000000:1.0:1736366173.823789:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366173.823789:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7216 00000100:00100000:2.0:1736366173.823821:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025088 00000100:00100000:3.0:1736366173.823821:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013024576 00000100:00100000:1.0:1736366173.823827:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013024896:12345-0@lo:38:kworker/u8:0.0 Request processed in 52us (205us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366173.823837:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77065 00000100:00100000:3.0:1736366173.823843:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1736366173.823847:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013024576:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366173.823851:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1736366173.823857:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013024832:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366173.823861:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1736366173.823865:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013024640:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366173.823874:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366173.823880:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013024576:12345-0@lo:400:kworker/u8:0.0 Request processed in 33us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366173.823886:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1736366173.823900:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013024640:12345-0@lo:38:kworker/u8:0.0 Request processed in 33us (410us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366173.823905:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013024832:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366173.823909:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1736366173.823913:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:3.0:1736366173.823914:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013024576:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366173.823931:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1736366173.823943:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:1.0:1736366173.823945:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013024768:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366173.823948:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b69300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013025088:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366173.823955:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366173.823955:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366173.823982:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b69300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013025088:12345-0@lo:38:kworker/u8:0.0 Request processed in 34us (313us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366173.823983:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013024768:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (427us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366173.823991:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1736366173.823995:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00080000:1.0:1736366173.824026:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366173.824029:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013024832:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366173.824031:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366173.824035:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013024768:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366173.824040:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00080000:1.0:1736366173.824047:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366173.824048:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9ce880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013024704:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366173.824051:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366173.824055:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013024896:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366173.824065:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366173.824068:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366173.824072:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013025088:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366173.824084:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366173.824087:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366173.824090:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013024640:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366173.824122:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9ce880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013024704:12345-0@lo:400:kworker/u8:0.0 Request processed in 73us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366173.824133:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1736366173.824198:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013024704:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366173.824223:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d62f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013024960:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366173.855372:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366174.857418:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366175.859439:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366176.575446:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736366176.575471:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d62f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013025152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366176.575538:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366176.575601:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025152 00000100:00100000:2.0:1736366176.575702:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5862 00000100:00100000:2.0:1736366176.575709:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013025152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366176.575741:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366176.575807:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013025152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366176.575815:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5862 00000100:00100000:3.0:1736366176.575853:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d62f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013025152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366176.591390:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013025216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366176.591432:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366176.591487:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025216 00000100:00100000:2.0:1736366176.591536:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5863 00000100:00100000:2.0:1736366176.591541:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013025216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366176.591579:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366176.591635:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013025216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366176.591663:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5863 00000100:00100000:3.0:1736366176.591690:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013025216:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366176.861356:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366177.863379:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366178.608243:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366178.608293:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366178.608336:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366178.608397:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015488 00000100:00100000:1.0:1736366178.608426:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015616 00000100:00100000:3.0:1736366178.608439:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015552 00000100:00100000:2.0:1736366178.608452:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 185 00000100:00100000:2.0:1736366178.608459:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041015488:12345-192.168.201.2@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1736366178.608488:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 690 00000100:00100000:1.0:1736366178.608493:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d65580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041015616:12345-192.168.201.2@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1736366178.608503:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 894 00000100:00100000:3.0:1736366178.608511:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d663c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041015552:12345-192.168.201.2@tcp:38:kworker/u8:2.0 00010000:02000000:3.0:1736366178.608532:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366178.608533:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041015488:12345-192.168.201.2@tcp:400:kworker/u8:2.0 Request processed in 74us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366178.608541:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d65580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041015616:12345-192.168.201.2@tcp:400:kworker/u8:2.0 Request processed in 47us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366178.608541:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 185 00000100:00100000:1.0:1736366178.608549:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 690 00000100:00100000:3.0:1736366178.608579:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d663c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041015552:12345-192.168.201.2@tcp:38:kworker/u8:2.0 Request processed in 68us (243us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366178.608597:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 894 00000100:00080000:0.0:1736366178.831329:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366178.831336:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366178.831339:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366178.831344:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8521 00000100:00080000:0.0:1736366178.831347:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366178.831352:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366178.831369:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d62f80 x1820703013025344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366178.831396:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366178.831399:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366178.831400:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366178.831403:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8521 00000100:00080000:0.0:1736366178.831405:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366178.831417:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366178.831428:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d60000 x1820703013025472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366178.831432:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013025280:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366178.831442:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013025408:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366178.831450:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366178.831453:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366178.831454:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366178.831457:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8521 00000100:00080000:0.0:1736366178.831458:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366178.831461:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366178.831469:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d65f00 x1820703013025600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366178.831484:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366178.831486:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736366178.831487:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366178.831489:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736366178.831489:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d62f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013025344:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366178.831490:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366178.831492:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8521 00000100:00080000:0.0:1736366178.831493:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366178.831496:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366178.831504:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d60e40 x1820703013025792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366178.831515:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013025728:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366178.831524:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013025664:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366178.831532:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366178.831539:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366178.831545:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025280 00000100:00100000:3.0:1736366178.831559:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366178.831568:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013025472:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366178.831572:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1736366178.831575:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736366178.831577:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013025280:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366178.831580:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013025536:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366178.831586:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366178.831591:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025728 00000100:00100000:1.0:1736366178.831602:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013025600:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366178.831603:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366178.831649:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025664 00000100:00100000:1.0:1736366178.831660:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366178.831660:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7217 00000100:00100000:3.0:1736366178.831666:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cf200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013025728:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366178.831678:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013025792:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366178.831678:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7218 00000100:00100000:2.0:1736366178.831683:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0daf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013025664:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366178.831693:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013025280:12345-0@lo:400:kworker/u8:0.0 Request processed in 114us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366178.831700:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1736366178.831700:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366178.831704:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cf200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013025728:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366178.831710:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7217 00000100:00100000:2.0:1736366178.831725:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0daf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013025664:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366178.831732:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7218 00000100:00100000:1.0:1736366178.831733:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025600 00000100:00100000:3.0:1736366178.831740:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025408 00000100:00100000:0.0:1736366178.831748:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025344 00000100:00100000:1.0:1736366178.831754:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77066 00000100:00100000:1.0:1736366178.831758:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b68980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013025600:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366178.831762:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025472 00010000:02000000:1.0:1736366178.831769:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366178.831769:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025536 00000100:00100000:2.0:1736366178.831770:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013025728:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366178.831772:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025792 00000100:00100000:3.0:1736366178.831778:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1736366178.831779:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013025280:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366178.831782:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013025408:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366178.831784:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1736366178.831788:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013025536:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366178.831796:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b68980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013025600:12345-0@lo:38:kworker/u8:0.0 Request processed in 37us (136us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366178.831802:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77066 00000100:00100000:2.0:1736366178.831805:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013025664:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366178.831809:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013025408:12345-0@lo:400:kworker/u8:0.0 Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366178.831815:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1736366178.831822:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013025536:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366178.831823:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1736366178.831827:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013025344:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366178.831828:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:0.0:1736366178.831833:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:3.0:1736366178.831833:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013025472:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366178.831834:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366178.831835:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013025536:0@lo:400:kworker/u8:0.0 00010000:02000000:3.0:1736366178.831843:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366178.831844:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:0.0:1736366178.831847:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013025792:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366178.831849:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013025344:12345-0@lo:38:kworker/u8:0.0 Request processed in 22us (319us total) trans 0 rc -19/-19 00010000:02000000:0.0:1736366178.831856:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366178.831856:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1736366178.831862:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013025472:12345-0@lo:38:kworker/u8:0.0 Request processed in 30us (276us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366178.831874:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013025792:12345-0@lo:38:kworker/u8:0.0 Request processed in 27us (174us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366178.831878:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:0.0:1736366178.831881:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00080000:1.0:1736366178.831882:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366178.831885:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366178.831888:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013025792:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366178.831896:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366178.831906:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366178.831909:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d62f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013025344:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366178.831909:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013025408:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366178.831921:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366178.831923:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366178.831925:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013025472:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366178.831932:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366178.831934:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366178.831936:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013025600:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366178.865347:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366179.867392:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366180.869395:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:0.0:1736366181.544271:0:17953:0:(genops.c:1786:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 32 seconds. The obd refcount = 4. Is it stuck? 00000020:02000400:0.0:1736366181.549370:0:17953:0:(genops.c:1752:print_export_data()) lustre-MDT0000: UNLINKED ffff88012c763800 cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 192.168.201.2@tcp 1 (0 0 0) 1 0 1 0: (null) 536870912003 stale:0 00000100:00100000:3.0:1736366181.583482:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013025856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366181.583556:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366181.583646:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025856 00000100:00100000:0.0:1736366181.583698:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5864 00000100:00100000:0.0:1736366181.583705:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013645a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013025856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366181.583737:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366181.583797:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013645a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013025856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366181.583805:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5864 00000100:00100000:3.0:1736366181.583845:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013025856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366181.599412:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013025920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366181.599456:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366181.599513:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025920 00000100:00100000:0.0:1736366181.599586:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5865 00000100:00100000:0.0:1736366181.599592:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cb440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013025920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366181.599616:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366181.599683:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cb440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013025920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366181.599690:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5865 00000100:00100000:2.0:1736366181.599713:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013025920:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366181.871428:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366182.873453:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366183.616265:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366183.616317:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366183.616362:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366183.616415:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015808 00000100:00100000:2.0:1736366183.616452:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015680 00000100:00100000:1.0:1736366183.616468:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015744 00000100:00100000:1.0:1736366183.616502:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 693 00000100:00100000:2.0:1736366183.616509:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 187 00000100:00100000:1.0:1736366183.616510:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d62ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041015808:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366183.616514:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 898 00000100:00100000:2.0:1736366183.616515:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041015680:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366183.616522:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d650c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041015744:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366183.616563:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366183.616612:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d62ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041015808:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 102us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366183.616612:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041015680:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 96us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366183.616615:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d650c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041015744:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 93us (254us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366183.616621:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 187 00000100:00100000:1.0:1736366183.616622:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 693 00000100:00100000:3.0:1736366183.616626:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 898 00000100:00080000:0.0:1736366183.839359:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366183.839365:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366183.839369:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366183.839376:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8526 00000100:00100000:2.0:1736366183.839376:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1736366183.839379:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366183.839385:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366183.839396:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013025984:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366183.839402:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d61c80 x1820703013026048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366183.839430:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366183.839433:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366183.839435:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366183.839438:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8526 00000100:00080000:0.0:1736366183.839439:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366183.839442:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366183.839446:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366183.839450:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d65f00 x1820703013026176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366183.839455:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013026048:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366183.839463:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013026112:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366183.839464:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366183.839465:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366183.839467:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366183.839468:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366183.839471:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8526 00000100:00080000:0.0:1736366183.839487:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366183.839491:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366183.839502:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d62f80 x1820703013026304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366183.839503:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366183.839545:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013025984 00000100:00080000:0.0:1736366183.839551:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366183.839554:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366183.839556:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366183.839559:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8526 00000100:00080000:0.0:1736366183.839560:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366183.839563:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366183.839565:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026048 00000100:00100000:0.0:1736366183.839570:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d61300 x1820703013026496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366183.839580:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013026176:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366183.839592:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1736366183.839592:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1736366183.839597:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013026048:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366183.839600:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013025984:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366183.839602:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1736366183.839612:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366183.839613:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d62f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013026304:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366183.839621:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026176 00000100:00100000:1.0:1736366183.839635:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366183.839643:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:0.0:1736366183.839648:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013026176:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366183.839657:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366183.839668:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013026048:12345-0@lo:38:kworker/u8:0.0 Request processed in 70us (166us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366183.839675:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00080000:1.0:1736366183.839678:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366183.839680:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013025984:12345-0@lo:400:kworker/u8:0.0 Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00080000:1.0:1736366183.839681:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366183.839691:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1736366183.839695:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013026048:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366183.839697:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013026176:12345-0@lo:38:kworker/u8:0.0 Request processed in 48us (94us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366183.839698:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366183.839703:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:1.0:1736366183.839714:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013026496:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366183.839716:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013026240:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366183.839720:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026112 00000100:00100000:2.0:1736366183.839730:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013026368:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366183.839737:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366183.839739:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1736366183.839743:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013026112:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366183.839758:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366183.839760:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736366183.839761:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366183.839764:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013026176:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366183.839765:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366183.839772:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013026112:12345-0@lo:400:kworker/u8:0.0 Request processed in 28us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366183.839778:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1736366183.839784:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013026112:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366183.839787:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026496 00000100:00100000:2.0:1736366183.839790:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013025984:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366183.839791:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026304 00000100:00100000:0.0:1736366183.839807:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026240 00000100:00100000:1.0:1736366183.839812:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77067 00000100:00100000:3.0:1736366183.839812:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:2.0:1736366183.839814:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736366183.839818:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b684c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013026304:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366183.839818:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013026496:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366183.839820:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013026432:0@lo:400:kworker/u8:0.0 00010000:02000000:3.0:1736366183.839827:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736366183.839829:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366183.839830:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1736366183.839834:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0db900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013026240:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366183.839845:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366183.839862:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013026496:12345-0@lo:38:kworker/u8:0.0 Request processed in 45us (125us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366183.839864:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b684c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013026304:12345-0@lo:38:kworker/u8:0.0 Request processed in 47us (229us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366183.839868:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:1.0:1736366183.839871:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77067 00000100:00100000:0.0:1736366183.839874:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0db900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013026240:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366183.839880:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:2.0:1736366183.839889:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026368 00000100:00080000:3.0:1736366183.839895:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366183.839898:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366183.839901:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013026496:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366183.839910:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026432 00000100:00080000:3.0:1736366183.839910:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366183.839913:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013026240:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366183.839913:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366183.839915:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7219 00000100:00100000:3.0:1736366183.839915:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d62f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013026304:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366183.839920:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cd580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013026368:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366183.839927:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7220 00000100:00100000:2.0:1736366183.839932:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013026432:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366183.839957:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cd580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013026368:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366183.839965:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7219 00000100:00100000:2.0:1736366183.839965:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013026432:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366183.839971:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7220 00000100:00100000:3.0:1736366183.839977:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013026432:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366183.839986:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013026368:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366183.875386:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366184.877400:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366185.879410:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366186.591583:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013026560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366186.591653:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366186.591725:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026560 00000100:00100000:0.0:1736366186.591778:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5866 00000100:00100000:0.0:1736366186.591784:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c84c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013026560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366186.591817:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366186.591867:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c84c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013026560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366186.591874:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5866 00000100:00100000:2.0:1736366186.591896:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013026560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366186.607456:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736366186.607472:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0dcc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013026624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366186.607534:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366186.607655:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026624 00000100:00100000:0.0:1736366186.607702:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5867 00000100:00100000:0.0:1736366186.607707:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9ca140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013026624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366186.607731:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366186.607775:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9ca140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013026624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366186.607782:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5867 00000100:00100000:2.0:1736366186.607796:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0dcc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013026624:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366186.881393:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366187.883373:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366188.624107:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366188.624151:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366188.624207:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015872 00000100:00100000:0.0:1736366188.624218:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366188.624258:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 189 00000100:00100000:3.0:1736366188.624266:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041015872:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366188.624284:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016000 00000100:00100000:1.0:1736366188.624314:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041015936 00000100:00100000:3.0:1736366188.624336:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041015872:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 71us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366188.624342:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 696 00000100:00100000:2.0:1736366188.624348:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d676c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041016000:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366188.624351:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 902 00000100:00100000:1.0:1736366188.624357:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d67200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041015936:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366188.624360:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 189 00010000:02000000:1.0:1736366188.624374:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366188.624396:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d676c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041016000:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 48us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366188.624404:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 696 00000100:00100000:1.0:1736366188.624412:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d67200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041015936:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 55us (195us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366188.624434:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 902 00000100:00080000:0.0:1736366188.847320:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366188.847327:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366188.847338:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366188.847344:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8531 00000100:00080000:0.0:1736366188.847347:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366188.847353:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366188.847372:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d60000 x1820703013026752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366188.847403:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366188.847406:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366188.847407:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366188.847410:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8531 00000100:00080000:0.0:1736366188.847412:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00100000:3.0:1736366188.847414:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013026688:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366188.847415:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366188.847423:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d604c0 x1820703013026880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366188.847426:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013026816:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366188.847504:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366188.847507:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366188.847509:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366188.847512:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8531 00000100:00080000:0.0:1736366188.847514:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:1.0:1736366188.847516:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366188.847517:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366188.847530:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d61300 x1820703013027008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366188.847539:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013026752:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366188.847548:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366188.847551:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366188.847552:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366188.847552:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1736366188.847555:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8531 00000100:00100000:1.0:1736366188.847562:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013027136:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366188.847564:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366188.847567:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366188.847569:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366188.847578:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d65f00 x1820703013027200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366188.847586:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366188.847599:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366188.847606:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d62f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013026944:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366188.847610:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013026880:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366188.847613:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026688 00000100:00100000:1.0:1736366188.847626:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013027072:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366188.847629:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366188.847640:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1736366188.847645:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013026688:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366188.847652:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027136 00000100:00100000:1.0:1736366188.847663:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366188.847668:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013027008:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366188.847680:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027072 00000100:00100000:3.0:1736366188.847680:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013026688:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366188.847686:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1736366188.847691:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7221 00000100:00100000:2.0:1736366188.847691:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366188.847697:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7222 00000100:00100000:1.0:1736366188.847698:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013027136:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366188.847702:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a01c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013027072:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366188.847703:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013027200:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366188.847711:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026816 00000100:00100000:2.0:1736366188.847717:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366188.847732:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026752 00000100:00100000:1.0:1736366188.847738:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013027136:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366188.847743:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026880 00000100:00100000:0.0:1736366188.847746:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a01c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013027072:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366188.847746:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7221 00000100:00100000:2.0:1736366188.847751:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027200 00000100:00100000:0.0:1736366188.847752:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7222 00000100:00100000:3.0:1736366188.847753:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:3.0:1736366188.847756:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013026816:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366188.847769:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:2.0:1736366188.847774:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013026752:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366188.847779:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027008 00000100:00100000:3.0:1736366188.847780:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013026816:12345-0@lo:400:kworker/u8:0.0 Request processed in 23us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366188.847783:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366188.847786:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00010000:02000000:2.0:1736366188.847787:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366188.847794:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013026944 00000100:00100000:1.0:1736366188.847796:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77068 00000100:00100000:1.0:1736366188.847799:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013027008:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366188.847803:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:3.0:1736366188.847806:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d61c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013026944:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:1.0:1736366188.847809:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366188.847814:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013026752:12345-0@lo:38:kworker/u8:0.0 Request processed in 40us (229us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366188.847821:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:0.0:1736366188.847826:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013026880:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366188.847829:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d61c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013026944:12345-0@lo:400:kworker/u8:0.0 Request processed in 22us (47us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366188.847834:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013027008:12345-0@lo:38:kworker/u8:0.0 Request processed in 34us (143us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366188.847834:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00010000:02000000:0.0:1736366188.847835:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366188.847840:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77068 00000100:00100000:3.0:1736366188.847849:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1736366188.847852:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1736366188.847856:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cf6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013027200:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366188.847858:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013026880:12345-0@lo:38:kworker/u8:0.0 Request processed in 31us (229us total) trans 0 rc -19/-19 00010000:02000000:2.0:1736366188.847862:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366188.847864:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1736366188.847871:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013027072:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366188.847879:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013026688:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366188.847880:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cf6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013027200:12345-0@lo:38:kworker/u8:0.0 Request processed in 23us (162us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366188.847885:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:0.0:1736366188.847891:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d62f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013026944:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366188.847893:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013027136:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366188.847901:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013026816:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366188.847915:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366188.847918:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366188.847921:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013027008:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366188.847928:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366188.847940:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366188.847943:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013027200:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366188.847954:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366188.847956:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366188.847958:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013026752:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366188.847966:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366188.847967:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366188.847969:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013026880:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366188.885392:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366189.887389:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366190.889401:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366191.599421:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9c9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013027264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366191.599488:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366191.599582:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027264 00000100:00100000:0.0:1736366191.599641:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5868 00000100:00100000:0.0:1736366191.599648:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a05f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013027264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366191.599680:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366191.599741:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a05f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013027264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366191.599763:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5868 00000100:00100000:1.0:1736366191.599791:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9c9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013027264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366191.615448:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0df6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013027328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366191.615492:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366191.615553:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027328 00000100:00100000:0.0:1736366191.615587:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5869 00000100:00100000:0.0:1736366191.615592:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013027328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366191.615615:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366191.615657:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013027328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366191.615664:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5869 00000100:00100000:2.0:1736366191.615674:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0df6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013027328:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366191.891385:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366192.893435:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366193.631926:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366193.631972:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366193.632027:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366193.632065:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016192 00000100:00100000:2.0:1736366193.632065:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016064 00000100:00100000:3.0:1736366193.632089:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016128 00000100:00100000:0.0:1736366193.632105:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 699 00000100:00100000:2.0:1736366193.632111:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 191 00000100:00100000:0.0:1736366193.632113:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d62f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041016192:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366193.632117:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041016064:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366193.632146:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 906 00000100:00100000:3.0:1736366193.632152:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d604c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041016128:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366193.632197:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366193.632208:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d62f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041016192:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 95us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366193.632216:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 699 00000100:00100000:2.0:1736366193.632230:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041016064:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 113us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366193.632238:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 191 00000100:00100000:3.0:1736366193.632248:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d604c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041016128:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 95us (221us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366193.632256:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 906 00000100:00080000:0.0:1736366193.855325:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366193.855332:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366193.855335:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366193.855340:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8536 00000100:00080000:0.0:1736366193.855344:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366193.855349:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366193.855408:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013027392:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366193.855430:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d65f00 x1820703013027456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366193.855469:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366193.855484:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013027456:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366193.855491:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366193.855494:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366193.855496:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366193.855499:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8536 00000100:00080000:0.0:1736366193.855501:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366193.855505:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366193.855515:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d60e40 x1820703013027584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366193.855528:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1736366193.855530:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736366193.855530:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366193.855533:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366193.855534:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366193.855537:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8536 00000100:00080000:0.0:1736366193.855538:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366193.855541:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366193.855541:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013027648:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366193.855550:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d64280 x1820703013027712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366193.855558:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013027584:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366193.855575:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366193.855578:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366193.855579:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366193.855579:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366193.855582:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8536 00000100:00080000:0.0:1736366193.855583:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366193.855586:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366193.855596:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d2417c0 x1820703013027904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366193.855600:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027392 00000100:00100000:1.0:1736366193.855605:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013027520:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366193.855607:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027456 00000100:00100000:0.0:1736366193.855625:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027648 00000100:00100000:1.0:1736366193.855627:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366193.855636:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1736366193.855641:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013027392:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366193.855653:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027520 00000100:00100000:0.0:1736366193.855660:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1736366193.855665:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a03440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013027648:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366193.855667:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:1.0:1736366193.855674:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a05580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013027456:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366193.855685:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:3.0:1736366193.855686:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013027392:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (219us total) trans 0 rc 0/0 00010000:02000000:1.0:1736366193.855687:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366193.855693:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a04c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013027520:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366193.855693:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1736366193.855713:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a03440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013027648:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366193.855719:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1736366193.855721:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a05580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013027456:12345-0@lo:38:kworker/u8:0.0 Request processed in 48us (192us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366193.855728:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1736366193.855745:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013027776:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366193.855751:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a04c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013027520:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366193.855762:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1736366193.855765:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013027648:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366193.855771:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366193.855775:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013027520:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366193.855787:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736366193.855793:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800869c4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013027840:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366193.855795:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366193.855800:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013027392:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366193.855808:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366193.855828:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027584 00000100:00100000:1.0:1736366193.855830:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027776 00000100:00080000:2.0:1736366193.855840:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366193.855844:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00080000:2.0:1736366193.855844:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366193.855849:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013027584:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366193.855849:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013027456:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366193.855853:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027840 00010000:02000000:0.0:1736366193.855858:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366193.855866:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7223 00000100:00100000:2.0:1736366193.855870:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013027712:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366193.855871:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d241c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013027776:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366193.855873:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7224 00000100:00100000:3.0:1736366193.855879:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d2450c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013027840:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366193.855883:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013027584:12345-0@lo:38:kworker/u8:0.0 Request processed in 34us (90us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366193.855889:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:2.0:1736366193.855897:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366193.855916:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2417c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013027904:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366193.855929:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d241c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013027776:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366193.855938:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7223 00000100:00100000:2.0:1736366193.855939:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366193.855939:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d2450c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013027840:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366193.855941:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800869c4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013027840:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366193.855946:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7224 00000100:00100000:0.0:1736366193.855950:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013027776:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366193.855955:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366193.855957:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366193.855960:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013027584:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366193.855970:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027904 00000100:00100000:3.0:1736366193.855976:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027712 00000100:00100000:0.0:1736366193.855985:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1736366193.855988:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a01c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013027904:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366193.855994:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77069 00010000:02000000:0.0:1736366193.855996:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366193.855998:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a03dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013027712:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366193.856007:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366193.856045:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a01c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013027904:12345-0@lo:38:kworker/u8:0.0 Request processed in 55us (108us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366193.856051:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:3.0:1736366193.856055:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a03dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013027712:12345-0@lo:38:kworker/u8:0.0 Request processed in 56us (158us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366193.856061:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77069 00000100:00080000:2.0:1736366193.856077:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366193.856080:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366193.856083:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013027712:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366193.856091:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366193.856093:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366193.856095:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2417c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013027904:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366193.895426:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366194.897439:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366195.899430:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366196.607534:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092a01300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013027968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366196.607605:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366196.607676:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013027968 00000100:00100000:0.0:1736366196.607740:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5870 00000100:00100000:0.0:1736366196.607747:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013027968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366196.607780:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366196.607838:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013027968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366196.607846:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5870 00000100:00100000:3.0:1736366196.607952:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092a01300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013027968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366196.623376:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736366196.623391:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073a03900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013028032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366196.623430:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366196.623555:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028032 00000100:00100000:1.0:1736366196.623604:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5871 00000100:00100000:1.0:1736366196.623609:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0de3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013028032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736366196.623632:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:1.0:1736366196.623685:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0de3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013028032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366196.623692:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5871 00000100:00100000:3.0:1736366196.623724:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073a03900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013028032:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366196.901504:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366197.903427:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366198.640328:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366198.640378:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366198.640421:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366198.640467:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016384 00000100:00100000:2.0:1736366198.640473:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016256 00000100:00100000:0.0:1736366198.640504:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016320 00000100:00100000:1.0:1736366198.640514:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 702 00000100:00100000:1.0:1736366198.640524:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d245580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041016384:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366198.640531:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 193 00000100:00100000:2.0:1736366198.640537:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013063e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041016256:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366198.640540:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 910 00000100:00100000:0.0:1736366198.640545:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d246d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041016320:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:0.0:1736366198.640561:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366198.640608:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013063e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041016256:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 70us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366198.640611:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d246d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041016320:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 65us (190us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366198.640611:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d245580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041016384:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366198.640616:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 193 00000100:00100000:0.0:1736366198.640618:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 910 00000100:00100000:1.0:1736366198.640622:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 702 00000100:00080000:0.0:1736366198.863354:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366198.863363:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366198.863367:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366198.863375:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8541 00000100:00080000:0.0:1736366198.863381:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366198.863389:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366198.863415:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d240980 x1820703013028160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366198.863420:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2463c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013028096:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366198.863476:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736366198.863486:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366198.863497:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366198.863499:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366198.863504:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8541 00000100:00080000:0.0:1736366198.863507:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366198.863512:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366198.863513:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d240980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013028160:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366198.863522:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d242140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013028224:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366198.863530:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d242ac0 x1820703013028288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366198.863539:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028096 00000100:00100000:3.0:1736366198.863561:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366198.863562:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366198.863566:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366198.863568:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736366198.863569:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00080000:0.0:1736366198.863573:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8541 00000100:00100000:2.0:1736366198.863575:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013028096:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366198.863576:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366198.863580:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366198.863583:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736366198.863594:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d243440 x1820703013028416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366198.863595:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d242f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013028352:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366198.863604:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d242ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013028288:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366198.863614:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013028096:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366198.863621:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:0.0:1736366198.863623:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366198.863627:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736366198.863628:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366198.863628:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1736366198.863629:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366198.863633:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8541 00000100:00080000:0.0:1736366198.863636:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:3.0:1736366198.863636:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d244280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013028480:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366198.863640:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366198.863651:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d244c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013028544:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366198.863652:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d244740 x1820703013028608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366198.863664:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366198.863671:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366198.863691:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028160 00000100:00100000:0.0:1736366198.863692:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028480 00000100:00100000:2.0:1736366198.863708:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028352 00000100:00100000:3.0:1736366198.863709:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366198.863723:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d243440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013028416:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366198.863724:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028224 00000100:00100000:2.0:1736366198.863724:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028288 00000100:00100000:0.0:1736366198.863731:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7225 00000100:00100000:2.0:1736366198.863732:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:2.0:1736366198.863736:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a04740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013028352:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366198.863738:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0da140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013028480:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366198.863748:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1736366198.863750:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366198.863754:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a02f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013028224:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366198.863762:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d244740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013028608:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366198.863769:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a04740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013028352:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366198.863775:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1736366198.863782:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366198.863784:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:2.0:1736366198.863788:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0ded40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013028160:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366198.863803:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0da140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013028480:12345-0@lo:400:kworker/u8:0.0 Request processed in 65us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366198.863803:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a02f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013028224:12345-0@lo:400:kworker/u8:0.0 Request processed in 47us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366198.863805:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028608 00010000:02000000:2.0:1736366198.863811:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366198.863814:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7225 00000100:00100000:1.0:1736366198.863820:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1736366198.863824:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:3.0:1736366198.863829:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0de880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013028288:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366198.863840:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:2.0:1736366198.863842:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0ded40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013028160:12345-0@lo:38:kworker/u8:0.0 Request processed in 52us (281us total) trans 0 rc -19/-19 00010000:02000000:3.0:1736366198.863842:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366198.863846:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0ddf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013028608:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366198.863849:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00010000:02000000:1.0:1736366198.863858:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366198.863868:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0de880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013028288:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (159us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366198.863874:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d244280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013028480:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366198.863878:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366198.863881:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366198.863885:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d242ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013028288:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366198.863886:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:1.0:1736366198.863893:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0ddf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013028608:12345-0@lo:38:kworker/u8:0.0 Request processed in 46us (109us total) trans 0 rc -19/-19 00000100:00080000:2.0:1736366198.863894:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366198.863897:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366198.863899:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d240980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013028160:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366198.863903:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:3.0:1736366198.863913:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028416 00000100:00080000:2.0:1736366198.863921:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366198.863924:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366198.863926:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d244740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013028608:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366198.863931:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77070 00000100:00100000:3.0:1736366198.863934:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0df200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013028416:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366198.863937:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d242f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013028352:0@lo:400:kworker/u8:0.0 00010000:02000000:3.0:1736366198.863942:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366198.863943:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366198.863970:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d242140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013028224:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366198.863974:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0df200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013028416:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (223us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366198.863979:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77070 00000100:00100000:2.0:1736366198.863984:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2463c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013028096:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366198.864017:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028544 00000100:00080000:2.0:1736366198.864019:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366198.864022:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366198.864027:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d243440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013028416:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366198.864046:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7226 00000100:00100000:0.0:1736366198.864052:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a02f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013028544:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366198.864110:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a02f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013028544:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366198.864118:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7226 00000100:00100000:2.0:1736366198.864145:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d244c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013028544:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366198.905420:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366199.907388:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366200.909427:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366201.615616:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736366201.615637:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092a017c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013028672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366201.615706:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366201.615790:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028672 00000100:00100000:1.0:1736366201.615852:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5872 00000100:00100000:1.0:1736366201.615858:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d244280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013028672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1736366201.615890:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736366201.615948:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d244280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013028672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366201.615959:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5872 00000100:00100000:0.0:1736366201.616014:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092a017c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013028672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366201.631430:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013028736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366201.631478:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366201.631545:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028736 00000100:00100000:1.0:1736366201.631594:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5873 00000100:00100000:1.0:1736366201.631601:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d245a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013028736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736366201.631627:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:1.0:1736366201.631680:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d245a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013028736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366201.631692:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5873 00000100:00100000:0.0:1736366201.631739:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0d84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013028736:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366201.911526:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366202.913565:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366203.648320:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366203.648369:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366203.648412:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366203.648419:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016576 00000100:00100000:1.0:1736366203.648466:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016512 00000100:00100000:1.0:1736366203.648485:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 705 00000100:00100000:1.0:1736366203.648492:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d243dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041016576:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366203.648503:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016448 00000100:00100000:3.0:1736366203.648520:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 914 00000100:00100000:3.0:1736366203.648527:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d243900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041016512:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366203.648545:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366203.648547:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 195 00000100:00100000:2.0:1736366203.648553:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041016448:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366203.648576:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d243dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041016576:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366203.648584:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 705 00000100:00100000:3.0:1736366203.648588:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d243900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041016512:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 59us (175us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366203.648600:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 914 00000100:00100000:2.0:1736366203.648608:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041016448:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 55us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366203.648616:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 195 00000100:00080000:0.0:1736366203.871369:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366203.871376:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366203.871380:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366203.871387:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8546 00000100:00080000:0.0:1736366203.871408:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366203.871416:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366203.871436:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d240000 x1820703013028864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366203.871436:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2404c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013028800:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366203.871476:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366203.871479:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366203.871481:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366203.871483:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8546 00000100:00100000:2.0:1736366203.871484:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1736366203.871485:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366203.871488:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366203.871496:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d2476c0 x1820703013028992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366203.871505:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d240e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013028928:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366203.871510:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366203.871512:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366203.871513:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366203.871515:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366203.871516:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8546 00000100:00080000:0.0:1736366203.871518:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366203.871521:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366203.871530:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d244c00 x1820703013029120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366203.871551:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366203.871554:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1736366203.871554:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366203.871555:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366203.871556:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2463c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013029248:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366203.871558:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8546 00000100:00080000:0.0:1736366203.871560:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366203.871569:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366203.871579:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d242140 x1820703013029312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366203.871579:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013028864:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366203.871580:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d246880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013029056:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366203.871595:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366203.871598:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366203.871623:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d243440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013029184:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366203.871627:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029248 00000100:00100000:3.0:1736366203.871638:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366203.871642:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366203.871662:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2476c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013028992:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366203.871673:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029184 00000100:00100000:3.0:1736366203.871681:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366203.871682:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7227 00000100:00100000:2.0:1736366203.871684:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028800 00000100:00100000:1.0:1736366203.871692:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a02140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013029248:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366203.871693:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d244c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013029120:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366203.871699:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7228 00000100:00100000:0.0:1736366203.871704:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a02600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013029184:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366203.871711:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366203.871713:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1736366203.871717:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013028800:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366203.871726:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d242140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013029312:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366203.871759:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366203.871767:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a02600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013029184:12345-0@lo:400:kworker/u8:0.0 Request processed in 62us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366203.871769:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013028800:12345-0@lo:400:kworker/u8:0.0 Request processed in 50us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366203.871770:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a02140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013029248:12345-0@lo:400:kworker/u8:0.0 Request processed in 76us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366203.871774:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7228 00000100:00100000:2.0:1736366203.871776:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1736366203.871781:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7227 00000100:00100000:3.0:1736366203.871788:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029120 00000100:00100000:0.0:1736366203.871810:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028928 00000100:00100000:1.0:1736366203.871819:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029056 00000100:00100000:2.0:1736366203.871821:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d243440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013029184:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366203.871822:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77071 00000100:00100000:3.0:1736366203.871827:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dcc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013029120:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366203.871829:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028864 00000100:00100000:0.0:1736366203.871839:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013028992 00010000:02000000:3.0:1736366203.871840:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366203.871842:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029312 00000100:00100000:0.0:1736366203.871847:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1736366203.871851:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a00980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013028928:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366203.871856:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1736366203.871861:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a017c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013029056:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366203.871866:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:2.0:1736366203.871870:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013028864:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366203.871875:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dcc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013029120:12345-0@lo:38:kworker/u8:0.0 Request processed in 48us (164us total) trans 0 rc -19/-19 00010000:02000000:2.0:1736366203.871880:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366203.871882:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a00980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013028928:12345-0@lo:400:kworker/u8:0.0 Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366203.871882:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77071 00000100:00100000:0.0:1736366203.871888:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1736366203.871899:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:0.0:1736366203.871902:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0df6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013028992:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366203.871903:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a017c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013029056:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366203.871904:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:3.0:1736366203.871907:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013029312:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366203.871909:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013028864:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (272us total) trans 0 rc -19/-19 00010000:02000000:0.0:1736366203.871911:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366203.871911:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00010000:02000000:3.0:1736366203.871914:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366203.871916:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:0.0:1736366203.871936:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0df6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013028992:12345-0@lo:38:kworker/u8:0.0 Request processed in 33us (255us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366203.871937:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013029312:12345-0@lo:38:kworker/u8:0.0 Request processed in 29us (178us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366203.871941:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d246880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013029056:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366203.871942:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:3.0:1736366203.871945:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1736366203.871950:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2463c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013029248:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366203.871965:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d240e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013028928:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366203.871967:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2404c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013028800:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366203.871969:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366203.871973:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366203.871976:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d242140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013029312:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366203.871985:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366203.871987:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366203.871990:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013028864:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366203.871997:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366203.871999:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366203.872001:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2476c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013028992:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366203.872007:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366203.872009:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366203.872011:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d244c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013029120:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366203.915370:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366204.917401:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366205.919434:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366206.623370:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736366206.623393:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d242f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013029376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366206.623463:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366206.623608:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029376 00000100:00100000:1.0:1736366206.623670:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5874 00000100:00100000:1.0:1736366206.623676:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013029376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1736366206.623710:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736366206.623772:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013029376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366206.623780:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5874 00000100:00100000:3.0:1736366206.623826:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d242f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013029376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366206.639371:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d244740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013029440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366206.639421:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366206.639504:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029440 00000100:00100000:1.0:1736366206.639551:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5875 00000100:00100000:1.0:1736366206.639556:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013029440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736366206.639577:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:1.0:1736366206.639627:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013029440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366206.639634:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5875 00000100:00100000:3.0:1736366206.639693:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d244740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013029440:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366206.921445:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366207.923358:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366208.655756:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366208.655794:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366208.655833:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366208.655868:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016640 00000100:00100000:3.0:1736366208.655868:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016768 00000100:00100000:3.0:1736366208.655901:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016704 00000100:00100000:2.0:1736366208.655906:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 197 00000100:00100000:2.0:1736366208.655911:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041016640:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366208.655918:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 708 00000100:00100000:3.0:1736366208.655921:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d240980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041016768:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366208.655925:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 918 00000100:00100000:1.0:1736366208.655929:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d242ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041016704:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366208.655940:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366208.655960:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d240980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041016768:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 38us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366208.655965:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 708 00000100:00100000:1.0:1736366208.655968:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d242ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041016704:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 39us (137us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366208.655969:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041016640:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 58us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366208.655972:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 918 00000100:00100000:2.0:1736366208.655975:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 197 00000100:00080000:0.0:1736366208.879286:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366208.879291:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366208.879293:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366208.879298:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8551 00000100:00080000:0.0:1736366208.879301:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366208.879305:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366208.879321:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d244740 x1820703013029568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366208.879329:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2417c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013029504:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366208.879340:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366208.879342:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366208.879342:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366208.879344:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8551 00000100:00080000:0.0:1736366208.879345:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366208.879346:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366208.879349:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d242f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013029632:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366208.879351:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d244c00 x1820703013029696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366208.879365:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366208.879366:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366208.879367:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366208.879368:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8551 00000100:00080000:0.0:1736366208.879369:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366208.879371:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366208.879376:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d240000 x1820703013029824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366208.879378:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366208.879387:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366208.879390:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366208.879398:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366208.879399:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736366208.879399:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2404c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013029952:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366208.879401:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8551 00000100:00080000:0.0:1736366208.879402:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366208.879403:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366208.879407:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d244740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013029568:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366208.879409:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d2463c0 x1820703013030016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366208.879412:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366208.879425:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029632 00000100:00100000:0.0:1736366208.879428:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029952 00000100:00100000:2.0:1736366208.879431:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029504 00000100:00100000:3.0:1736366208.879433:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366208.879444:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d244c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013029696:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366208.879448:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7229 00000100:00100000:1.0:1736366208.879448:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029568 00000100:00100000:2.0:1736366208.879448:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1736366208.879452:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a004c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013029952:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366208.879452:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013029504:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366208.879454:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366208.879460:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013029824:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366208.879467:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029696 00000100:00100000:3.0:1736366208.879473:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366208.879476:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013029504:12345-0@lo:400:kworker/u8:0.0 Request processed in 24us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366208.879477:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1736366208.879481:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a004c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013029952:12345-0@lo:400:kworker/u8:0.0 Request processed in 29us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366208.879482:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a06880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013029632:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366208.879482:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1736366208.879484:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7229 00000100:00100000:3.0:1736366208.879484:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2463c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013030016:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366208.879492:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366208.879499:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:2.0:1736366208.879501:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013029568:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366208.879504:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030016 00010000:02000000:2.0:1736366208.879509:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366208.879510:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:1.0:1736366208.879512:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a06880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013029632:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366208.879513:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013029696:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366208.879515:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029824 00010000:02000000:0.0:1736366208.879518:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366208.879518:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1736366208.879524:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013029568:12345-0@lo:38:kworker/u8:0.0 Request processed in 22us (91us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366208.879528:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77072 00000100:00100000:0.0:1736366208.879529:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013029696:12345-0@lo:38:kworker/u8:0.0 Request processed in 17us (75us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366208.879529:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:3.0:1736366208.879530:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0daac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013029824:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366208.879532:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013030016:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366208.879533:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:2.0:1736366208.879535:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00010000:02000000:3.0:1736366208.879536:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736366208.879538:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366208.879543:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2476c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013029760:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366208.879550:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0daac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013029824:12345-0@lo:38:kworker/u8:0.0 Request processed in 20us (77us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366208.879554:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77072 00000100:00100000:0.0:1736366208.879559:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366208.879559:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013030016:12345-0@lo:38:kworker/u8:0.0 Request processed in 26us (65us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366208.879563:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2404c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013029952:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366208.879564:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:2.0:1736366208.879568:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2417c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013029504:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366208.879568:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366208.879569:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1736366208.879570:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366208.879572:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d242140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013029888:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366208.879572:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2463c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013030016:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366208.879574:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029760 00000100:00080000:3.0:1736366208.879577:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366208.879578:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366208.879579:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d244740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013029568:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366208.879581:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736366208.879583:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366208.879584:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366208.879585:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d244c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013029696:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366208.879586:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1736366208.879589:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d240e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013029760:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366208.879589:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366208.879590:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366208.879591:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013029888 00000100:00100000:3.0:1736366208.879591:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013029824:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366208.879607:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7230 00000100:00100000:0.0:1736366208.879609:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d246880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013029888:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366208.879610:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d240e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013029760:12345-0@lo:400:kworker/u8:0.0 Request processed in 20us (51us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366208.879614:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1736366208.879624:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d246880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013029888:12345-0@lo:400:kworker/u8:0.0 Request processed in 15us (43us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366208.879627:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7230 00000100:00100000:1.0:1736366208.879633:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d242f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013029632:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366208.879644:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d242140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013029888:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366208.879649:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2476c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013029760:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366208.925362:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366209.927299:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366210.929423:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366211.631494:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1728e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013030080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366211.631566:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366211.631637:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030080 00000100:00100000:2.0:1736366211.631705:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5876 00000100:00100000:2.0:1736366211.631711:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013030080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366211.631752:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366211.631818:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013030080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366211.631826:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5876 00000100:00100000:1.0:1736366211.631862:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1728e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013030080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366211.647362:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013030144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366211.647403:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366211.647460:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030144 00000100:00100000:0.0:1736366211.647499:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5877 00000100:00100000:0.0:1736366211.647504:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a05f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013030144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366211.647526:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366211.647584:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a05f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013030144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366211.647591:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5877 00000100:00100000:2.0:1736366211.647641:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013030144:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366211.931395:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366212.933454:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366213.664273:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366213.664328:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366213.664368:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366213.664411:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016960 00000100:00100000:1.0:1736366213.664414:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016896 00000100:00100000:2.0:1736366213.664447:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041016832 00000100:00100000:1.0:1736366213.664466:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 711 00000100:00100000:0.0:1736366213.664473:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 922 00000100:00100000:1.0:1736366213.664475:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d2476c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041016960:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366213.664479:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d242140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041016896:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:2.0:1736366213.664487:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 199 00000100:00100000:2.0:1736366213.664493:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041016832:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:0.0:1736366213.664498:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366213.664553:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d242140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041016896:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 73us (185us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366213.664561:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 922 00000100:00100000:1.0:1736366213.664561:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d2476c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041016960:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 88us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366213.664568:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041016832:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 74us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366213.664570:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 711 00000100:00100000:2.0:1736366213.664576:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 199 00000100:00080000:0.0:1736366213.887338:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366213.887359:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366213.887362:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366213.887369:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8556 00000100:00080000:0.0:1736366213.887373:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366213.887379:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366213.887401:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d242f80 x1820703013030272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366213.887424:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1736366213.887440:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366213.887443:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366213.887445:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366213.887448:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8556 00000100:00080000:0.0:1736366213.887450:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00100000:1.0:1736366213.887451:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d243440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013030208:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366213.887453:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366213.887454:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013030336:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366213.887461:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d244c00 x1820703013030400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366213.887475:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366213.887477:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366213.887478:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366213.887481:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8556 00000100:00080000:0.0:1736366213.887483:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366213.887486:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366213.887494:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d2463c0 x1820703013030528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366213.887514:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366213.887517:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366213.887524:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366213.887528:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8556 00000100:00100000:3.0:1736366213.887528:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d242f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013030272:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366213.887530:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00100000:2.0:1736366213.887533:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366213.887534:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366213.887534:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366213.887546:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800869c4280 x1820703013030720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366213.887583:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d244740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013030464:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366213.887592:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2417c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013030592:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366213.887593:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366213.887604:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2404c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013030656:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366213.887627:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d244c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013030400:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366213.887633:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366213.887646:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366213.887678:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366213.887680:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030336 00000100:00100000:1.0:1736366213.887682:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030656 00000100:00100000:2.0:1736366213.887692:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030208 00000100:00100000:3.0:1736366213.887692:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2463c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013030528:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366213.887710:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366213.887714:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030272 00000100:00100000:2.0:1736366213.887723:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1736366213.887724:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7231 00000100:00100000:0.0:1736366213.887725:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030464 00000100:00100000:3.0:1736366213.887725:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800869c4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013030720:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366213.887729:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013030208:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366213.887732:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a050c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013030656:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366213.887734:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030400 00000100:00100000:3.0:1736366213.887740:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366213.887743:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1736366213.887748:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a02ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013030336:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366213.887765:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030528 00000100:00100000:2.0:1736366213.887772:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013030208:12345-0@lo:400:kworker/u8:0.0 Request processed in 43us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366213.887779:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1736366213.887786:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77073 00000100:00100000:0.0:1736366213.887787:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a02ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013030336:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366213.887791:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013030528:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366213.887796:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1736366213.887797:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a050c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013030656:12345-0@lo:400:kworker/u8:0.0 Request processed in 63us (148us total) trans 0 rc 0/0 00010000:02000000:3.0:1736366213.887805:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366213.887808:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7231 00000100:00100000:2.0:1736366213.887809:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030720 00000100:00100000:0.0:1736366213.887815:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1736366213.887819:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013030464:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366213.887824:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:2.0:1736366213.887828:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013030272:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366213.887835:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013030528:12345-0@lo:38:kworker/u8:0.0 Request processed in 44us (124us total) trans 0 rc -19/-19 00010000:02000000:2.0:1736366213.887838:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366213.887842:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77073 00000100:00100000:0.0:1736366213.887858:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013030464:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366213.887861:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2404c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013030656:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366213.887863:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:0.0:1736366213.887869:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:2.0:1736366213.887869:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013030272:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (274us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366213.887870:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1729300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013030400:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366213.887875:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00010000:02000000:3.0:1736366213.887877:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366213.887880:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:0.0:1736366213.887884:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013030720:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366213.887894:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366213.887894:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1729300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013030400:12345-0@lo:38:kworker/u8:0.0 Request processed in 26us (216us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366213.887897:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366213.887899:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:0.0:1736366213.887922:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013030720:12345-0@lo:38:kworker/u8:0.0 Request processed in 37us (181us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366213.887925:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d243440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013030208:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366213.887928:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366213.887931:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030592 00000100:00080000:3.0:1736366213.887931:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366213.887935:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800869c4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013030720:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366213.887936:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00080000:3.0:1736366213.887944:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366213.887946:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366213.887949:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d242f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013030272:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366213.887950:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7232 00000100:00100000:2.0:1736366213.887954:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a04280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013030592:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366213.887955:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366213.887964:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366213.887967:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d244c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013030400:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366213.887971:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d244740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013030464:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366213.887978:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366213.887980:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366213.887982:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2463c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013030528:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366213.887986:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a04280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013030592:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366213.887992:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7232 00000100:00100000:0.0:1736366213.887994:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013030336:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366213.888000:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2417c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013030592:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366213.935394:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366214.937394:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366215.939407:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366216.639567:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736366216.639593:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013030784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366216.639662:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366216.639732:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030784 00000100:00100000:0.0:1736366216.639796:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5878 00000100:00100000:0.0:1736366216.639803:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a063c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013030784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366216.639836:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366216.639897:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a063c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013030784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366216.639905:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5878 00000100:00100000:1.0:1736366216.639943:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013030784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366216.655443:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013030848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366216.655482:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366216.655547:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030848 00000100:00100000:0.0:1736366216.655594:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5879 00000100:00100000:0.0:1736366216.655599:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a076c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013030848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366216.655623:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366216.655675:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a076c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013030848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366216.655683:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5879 00000100:00100000:1.0:1736366216.655719:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013030848:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366216.941482:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366217.943456:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366218.672329:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366218.672384:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366218.672427:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366218.672491:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017152 00000100:00100000:3.0:1736366218.672519:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017024 00000100:00100000:1.0:1736366218.672541:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017088 00000100:00100000:2.0:1736366218.672548:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 714 00000100:00100000:2.0:1736366218.672555:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041017152:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366218.672561:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 201 00000100:00100000:3.0:1736366218.672567:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041017024:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366218.672595:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 926 00000100:00100000:1.0:1736366218.672600:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041017088:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366218.672617:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366218.672642:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041017152:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 87us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366218.672648:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041017024:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 78us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366218.672651:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 714 00000100:00100000:3.0:1736366218.672660:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 201 00000100:00100000:1.0:1736366218.672663:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041017088:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 63us (237us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366218.672671:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 926 00000100:00080000:0.0:1736366218.895330:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366218.895337:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366218.895341:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366218.895348:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8561 00000100:00080000:0.0:1736366218.895367:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366218.895374:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366218.895393:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a568980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013030912:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366218.895397:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56d580 x1820703013030976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366218.895442:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366218.895446:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366218.895447:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366218.895450:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8561 00000100:00080000:0.0:1736366218.895452:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366218.895455:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366218.895461:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013031040:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366218.895463:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a568000 x1820703013031104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366218.895475:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366218.895484:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366218.895487:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366218.895488:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366218.895490:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8561 00000100:00080000:0.0:1736366218.895492:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366218.895495:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366218.895503:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56f200 x1820703013031232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366218.895514:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013030976:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366218.895521:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366218.895522:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366218.895525:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366218.895526:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366218.895530:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8561 00000100:00080000:0.0:1736366218.895531:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00100000:1.0:1736366218.895534:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a568e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013031296:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366218.895540:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366218.895550:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56c740 x1820703013031424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366218.895552:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736366218.895558:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013031360:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366218.895562:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366218.895574:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366218.895576:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013031168:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366218.895585:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013031104:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366218.895600:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031040 00000100:00100000:3.0:1736366218.895626:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366218.895639:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031296 00000100:00100000:2.0:1736366218.895641:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030976 00000100:00100000:0.0:1736366218.895648:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031104 00000100:00100000:3.0:1736366218.895651:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013031232:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366218.895663:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1736366218.895670:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366218.895672:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a04740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013031040:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366218.895677:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7233 00000100:00100000:3.0:1736366218.895681:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013031424:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366218.895687:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:1.0:1736366218.895687:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a03900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013031296:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366218.895692:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a17284c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013030976:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366218.895695:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:0.0:1736366218.895708:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366218.895719:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031232 00000100:00100000:3.0:1736366218.895740:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77074 00000100:00100000:2.0:1736366218.895741:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a04740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013031040:12345-0@lo:400:kworker/u8:0.0 Request processed in 69us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366218.895746:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013031232:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366218.895748:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a03900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013031296:12345-0@lo:400:kworker/u8:0.0 Request processed in 62us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366218.895750:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1736366218.895758:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a17284c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013030976:12345-0@lo:38:kworker/u8:0.0 Request processed in 64us (195us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366218.895758:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7233 00000100:00100000:0.0:1736366218.895764:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00010000:02000000:3.0:1736366218.895766:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366218.895768:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031424 00000100:00100000:2.0:1736366218.895778:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:0.0:1736366218.895782:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:2.0:1736366218.895783:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013031104:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366218.895786:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013031424:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366218.895793:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366218.895794:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366218.895806:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a568e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013031296:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366218.895807:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013031232:12345-0@lo:38:kworker/u8:0.0 Request processed in 58us (133us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366218.895814:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013031424:12345-0@lo:38:kworker/u8:0.0 Request processed in 27us (119us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366218.895817:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77074 00000100:00100000:0.0:1736366218.895819:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:2.0:1736366218.895821:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013031104:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (194us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366218.895827:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:0.0:1736366218.895838:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366218.895849:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031168 00000100:00080000:3.0:1736366218.895866:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366218.895871:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366218.895877:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013031232:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366218.895880:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:2.0:1736366218.895884:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013031168:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366218.895891:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366218.895895:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366218.895898:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013031424:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366218.895911:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366218.895914:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366218.895916:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013031168:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366218.895918:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013030976:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366218.895931:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366218.895933:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00080000:3.0:1736366218.895933:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366218.895937:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013031104:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366218.895983:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013031168:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366218.895991:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366218.896020:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013030912 00000100:00100000:2.0:1736366218.896031:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013031040:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366218.896053:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031360 00000100:00100000:0.0:1736366218.896054:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1736366218.896059:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013030912:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366218.896093:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013030912:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366218.896098:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7234 00000100:00100000:0.0:1736366218.896100:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1736366218.896105:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a076c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013031360:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366218.896204:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a076c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013031360:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366218.896231:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7234 00000100:00100000:2.0:1736366218.896236:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013031360:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366218.896275:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a568980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013030912:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366218.945400:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366219.947415:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366220.949384:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366221.647476:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736366221.647503:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092a07200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013031488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366221.647591:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366221.647771:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031488 00000100:00100000:0.0:1736366221.647835:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5880 00000100:00100000:0.0:1736366221.647841:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013031488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366221.647875:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366221.647964:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013031488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366221.647975:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5880 00000100:00100000:3.0:1736366221.648035:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092a07200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013031488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366221.663390:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092a004c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013031552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366221.663432:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366221.663490:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031552 00000100:00100000:2.0:1736366221.663541:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5881 00000100:00100000:2.0:1736366221.663547:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013031552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366221.663571:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366221.663620:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013031552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366221.663627:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5881 00000100:00100000:0.0:1736366221.663639:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092a004c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013031552:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366221.951507:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366222.953472:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366223.680266:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366223.680322:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366223.680364:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366223.680380:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017216 00000100:00100000:3.0:1736366223.680409:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017344 00000100:00100000:2.0:1736366223.680433:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 203 00000100:00100000:2.0:1736366223.680440:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041017216:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366223.680471:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017280 00000100:00100000:1.0:1736366223.680477:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 717 00000100:00100000:1.0:1736366223.680487:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1875:x1820703041017344:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366223.680511:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041017216:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 71us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366223.680519:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 203 00000100:00100000:3.0:1736366223.680536:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 930 00000100:00100000:1.0:1736366223.680537:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1875:x1820703041017344:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 52us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366223.680545:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 717 00000100:00100000:3.0:1736366223.680545:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041017280:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366223.680566:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366223.680614:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041017280:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 69us (249us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366223.680625:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 930 00000100:00080000:0.0:1736366223.903352:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366223.903359:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366223.903363:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366223.903370:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8566 00000100:00080000:0.0:1736366223.903374:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366223.903381:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366223.903401:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56bdc0 x1820703013031680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366223.903438:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366223.903441:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366223.903443:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366223.903446:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8566 00000100:00080000:0.0:1736366223.903463:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366223.903467:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366223.903468:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a569c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013031616:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366223.903478:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a5684c0 x1820703013031808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366223.903487:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013031744:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366223.903493:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366223.903496:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366223.903497:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366223.903500:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8566 00000100:00080000:0.0:1736366223.903502:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366223.903505:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366223.903513:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56f6c0 x1820703013031936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366223.903535:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366223.903538:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366223.903539:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366223.903542:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8566 00000100:00080000:0.0:1736366223.903543:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:3.0:1736366223.903545:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013031680:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366223.903546:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366223.903548:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366223.903549:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366223.903555:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a568980 x1820703013032128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366223.903596:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a5697c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013032064:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366223.903600:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736366223.903603:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031616 00000100:00100000:3.0:1736366223.903605:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366223.903606:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013031872:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366223.903620:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366223.903630:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a5684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013031808:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366223.903631:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366223.903636:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736366223.903641:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1736366223.903647:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013031616:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366223.903649:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366223.903654:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013032000:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366223.903660:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032064 00000100:00100000:3.0:1736366223.903662:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013031936:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366223.903677:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366223.903687:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032000 00000100:00100000:3.0:1736366223.903689:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366223.903702:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013031616:12345-0@lo:400:kworker/u8:0.0 Request processed in 54us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366223.903704:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7235 00000100:00100000:2.0:1736366223.903707:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a569c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013031616:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366223.903708:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a568980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013032128:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366223.903709:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a06d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013032064:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366223.903720:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1736366223.903723:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366223.903744:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7236 00000100:00100000:1.0:1736366223.903749:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a06d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013032064:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366223.903750:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a03440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013032000:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366223.903755:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7235 00000100:00100000:3.0:1736366223.903756:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031936 00000100:00100000:0.0:1736366223.903761:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031744 00000100:00100000:3.0:1736366223.903777:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77075 00000100:00100000:3.0:1736366223.903782:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013031936:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366223.903783:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031680 00000100:00100000:2.0:1736366223.903783:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a03440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013032000:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366223.903784:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031872 00000100:00100000:2.0:1736366223.903790:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7236 00000100:00100000:0.0:1736366223.903791:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013031808 00000100:00100000:1.0:1736366223.903797:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032128 00010000:02000000:3.0:1736366223.903797:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366223.903800:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1736366223.903804:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a06d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013031744:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366223.903807:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1736366223.903811:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a00980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013031872:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366223.903814:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:2.0:1736366223.903818:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013031680:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366223.903830:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366223.903830:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013031936:12345-0@lo:38:kworker/u8:0.0 Request processed in 47us (140us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366223.903837:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77075 00000100:00100000:0.0:1736366223.903843:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a06d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013031744:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366223.903849:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1736366223.903890:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1736366223.903893:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a00980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013031872:12345-0@lo:400:kworker/u8:0.0 Request processed in 80us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366223.903893:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013031680:12345-0@lo:38:kworker/u8:0.0 Request processed in 73us (288us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366223.903894:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1729c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013031808:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366223.903900:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00010000:02000000:3.0:1736366223.903902:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366223.903903:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:0.0:1736366223.903908:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:0.0:1736366223.903912:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013032128:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366223.903922:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366223.903926:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1729c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013031808:12345-0@lo:38:kworker/u8:0.0 Request processed in 32us (277us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366223.903933:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013031872:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366223.903934:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013032000:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366223.903943:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1736366223.903944:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013031744:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366223.903945:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a5697c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013032064:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366223.903949:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013032128:12345-0@lo:38:kworker/u8:0.0 Request processed in 36us (225us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366223.903955:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00080000:3.0:1736366223.903986:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366223.903989:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366223.903993:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a568980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013032128:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366223.904002:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366223.904004:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366223.904006:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013031680:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366223.904013:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366223.904014:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366223.904016:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a5684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013031808:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366223.904024:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366223.904025:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366223.904027:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013031936:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366223.955393:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366224.957407:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366225.959447:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366226.655464:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013032192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366226.655538:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366226.655697:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032192 00000100:00100000:0.0:1736366226.655762:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5882 00000100:00100000:0.0:1736366226.655769:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a00e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013032192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366226.655802:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366226.655906:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a00e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013032192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366226.655915:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5882 00000100:00100000:1.0:1736366226.656023:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013032192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366226.671391:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013032256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366226.671436:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366226.671499:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032256 00000100:00100000:0.0:1736366226.671538:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5883 00000100:00100000:0.0:1736366226.671544:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a01300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013032256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366226.671568:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366226.671626:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a01300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013032256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366226.671634:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5883 00000100:00100000:2.0:1736366226.671648:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013032256:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366226.961493:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366227.963425:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366228.688225:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366228.688279:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366228.688321:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366228.688363:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017536 00000100:00100000:3.0:1736366228.688398:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017472 00000100:00100000:1.0:1736366228.688410:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017408 00000100:00100000:2.0:1736366228.688431:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 720 00000100:00100000:2.0:1736366228.688438:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041017536:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366228.688442:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 934 00000100:00100000:3.0:1736366228.688447:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041017472:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:1.0:1736366228.688448:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 205 00000100:00100000:1.0:1736366228.688454:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041017408:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:3.0:1736366228.688467:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366228.688533:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041017536:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 95us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366228.688534:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041017408:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 79us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366228.688535:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041017472:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 87us (213us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366228.688542:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 205 00000100:00100000:2.0:1736366228.688543:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 720 00000100:00100000:3.0:1736366228.688547:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 934 00000100:00080000:0.0:1736366228.911332:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366228.911340:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366228.911344:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366228.911351:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8572 00000100:00080000:0.0:1736366228.911356:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366228.911362:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366228.911382:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56c740 x1820703013032384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366228.911411:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366228.911414:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366228.911415:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366228.911419:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8572 00000100:00080000:0.0:1736366228.911420:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366228.911423:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366228.911431:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a568e40 x1820703013032512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366228.911446:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013032320:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366228.911451:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013032448:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366228.911457:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366228.911460:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366228.911461:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366228.911465:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8572 00000100:00100000:3.0:1736366228.911479:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013032384:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366228.911482:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366228.911486:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366228.911498:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56f6c0 x1820703013032640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366228.911518:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366228.911521:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366228.911522:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366228.911525:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8572 00000100:00080000:0.0:1736366228.911527:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366228.911529:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366228.911539:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a568980 x1820703013032832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366228.911541:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366228.911543:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366228.911566:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a5684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013032704:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366228.911595:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032448 00000100:00100000:1.0:1736366228.911603:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013032768:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366228.911615:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366228.911616:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013032576:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366228.911640:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032320 00000100:00100000:3.0:1736366228.911646:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:2.0:1736366228.911648:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366228.911654:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a06880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013032448:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366228.911661:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032704 00000100:00100000:1.0:1736366228.911669:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1736366228.911673:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013032320:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366228.911688:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7237 00000100:00100000:2.0:1736366228.911690:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032576 00000100:00100000:0.0:1736366228.911693:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013032704:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366228.911709:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013032320:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366228.911717:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:3.0:1736366228.911721:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a06880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013032448:12345-0@lo:400:kworker/u8:0.0 Request processed in 67us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366228.911722:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a063c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013032576:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366228.911726:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1736366228.911732:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013032704:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366228.911733:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1736366228.911739:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7237 00000100:00100000:1.0:1736366228.911759:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366228.911759:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a063c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013032576:12345-0@lo:400:kworker/u8:0.0 Request processed in 37us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366228.911765:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:3.0:1736366228.911765:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366228.911815:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032384 00000100:00100000:1.0:1736366228.911821:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013032320:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366228.911824:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a5684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013032704:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366228.911831:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:2.0:1736366228.911834:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013032384:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366228.911843:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a568e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013032512:0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366228.911849:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366228.911851:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032768 00000100:00100000:1.0:1736366228.911871:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7238 00000100:00100000:1.0:1736366228.911877:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a03dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013032768:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366228.911877:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013032384:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (114us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366228.911879:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366228.911883:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:2.0:1736366228.911892:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032512 00000100:00100000:3.0:1736366228.911902:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013032640:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366228.911903:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:2.0:1736366228.911906:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013032512:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366228.911910:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a03dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013032768:12345-0@lo:400:kworker/u8:0.0 Request processed in 33us (151us total) trans 0 rc 0/0 00010000:02000000:2.0:1736366228.911912:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366228.911915:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7238 00000100:00100000:2.0:1736366228.911932:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013032512:12345-0@lo:38:kworker/u8:0.0 Request processed in 24us (56us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366228.911934:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366228.911938:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013032768:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366228.911948:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:3.0:1736366228.911951:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a568980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013032832:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366228.911971:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032640 00000100:00100000:3.0:1736366228.911977:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366228.911982:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013032576:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366228.911986:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77076 00000100:00100000:1.0:1736366228.911989:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013032640:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366228.911999:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736366228.912003:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366228.912006:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013032448:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366228.912008:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366228.912013:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013032384:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366228.912021:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013032640:12345-0@lo:38:kworker/u8:0.0 Request processed in 31us (89us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366228.912021:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032832 00000100:00080000:3.0:1736366228.912026:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736366228.912027:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77076 00000100:00080000:3.0:1736366228.912030:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366228.912034:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a568e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013032512:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366228.912052:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:2.0:1736366228.912055:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013032832:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366228.912063:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736366228.912065:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366228.912068:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366228.912073:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013032640:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366228.912090:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013032832:12345-0@lo:38:kworker/u8:0.0 Request processed in 33us (114us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736366228.912090:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366228.912095:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00080000:3.0:1736366228.912102:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366228.912106:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a568980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013032832:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366228.965385:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366229.967453:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366230.969437:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366231.663565:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736366231.663590:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013032896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366231.663656:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366231.663843:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032896 00000100:00100000:0.0:1736366231.663918:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5884 00000100:00100000:0.0:1736366231.663927:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a050c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013032896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366231.663972:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366231.664070:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a050c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013032896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366231.664079:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5884 00000100:00100000:1.0:1736366231.664117:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013032896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366231.679409:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a5684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013032960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366231.679453:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366231.679591:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013032960 00000100:00100000:0.0:1736366231.679639:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5885 00000100:00100000:0.0:1736366231.679645:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a04c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013032960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366231.679668:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366231.679711:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a04c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013032960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366231.679717:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5885 00000100:00100000:2.0:1736366231.679753:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a5684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013032960:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366231.971422:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366232.973480:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366233.695812:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366233.695847:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366233.695872:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366233.695899:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017664 00000100:00100000:2.0:1736366233.695905:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017728 00000100:00100000:0.0:1736366233.695928:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 723 00000100:00100000:0.0:1736366233.695933:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a5697c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041017728:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366233.695934:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 938 00000100:00100000:3.0:1736366233.695935:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017600 00000100:00100000:2.0:1736366233.695937:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041017664:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:2.0:1736366233.695950:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366233.695958:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 207 00000100:00100000:3.0:1736366233.695961:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041017600:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366233.695979:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a5697c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041017728:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 47us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366233.695979:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041017664:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 41us (173us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366233.695983:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 723 00000100:00100000:3.0:1736366233.695984:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041017600:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 23us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366233.695986:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 938 00000100:00100000:3.0:1736366233.695988:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 207 00000100:00080000:0.0:1736366233.919245:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366233.919249:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366233.919251:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366233.919256:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8577 00000100:00080000:0.0:1736366233.919258:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366233.919262:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366233.919274:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a569c80 x1820703013033088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366233.919298:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013033024:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366233.919302:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366233.919304:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366233.919305:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366233.919307:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8577 00000100:00080000:0.0:1736366233.919308:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366233.919310:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366233.919313:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736366233.919314:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a568980 x1820703013033216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366233.919321:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366233.919323:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366233.919323:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366233.919325:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8577 00000100:00100000:2.0:1736366233.919325:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013033280:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366233.919326:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366233.919327:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366233.919332:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a568e40 x1820703013033344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366233.919343:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366233.919344:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366233.919345:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366233.919347:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8577 00000100:00080000:0.0:1736366233.919347:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1736366233.919347:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366233.919349:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366233.919350:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a569c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013033088:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366233.919353:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56b440 x1820703013033536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366233.919359:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366233.919372:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013033472:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366233.919380:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a5684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013033152:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366233.919382:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366233.919383:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033280 00000100:00100000:1.0:1736366233.919388:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366233.919394:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013033408:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366233.919399:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a568980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013033216:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366233.919405:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366233.919407:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033472 00000100:00100000:0.0:1736366233.919409:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033088 00000100:00100000:3.0:1736366233.919409:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366233.919416:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a568e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013033344:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366233.919417:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033216 00000100:00100000:1.0:1736366233.919422:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033408 00000100:00100000:0.0:1736366233.919426:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1736366233.919426:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7239 00000100:00100000:3.0:1736366233.919427:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366233.919430:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a02140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013033280:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366233.919430:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fb08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013033472:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366233.919433:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7240 00000100:00100000:1.0:1736366233.919435:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a00e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013033408:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366233.919437:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013033536:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366233.919446:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366233.919457:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fb08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013033472:12345-0@lo:400:kworker/u8:0.0 Request processed in 28us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366233.919459:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a00e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013033408:12345-0@lo:400:kworker/u8:0.0 Request processed in 23us (53us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366233.919461:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7239 00000100:00100000:0.0:1736366233.919463:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a02140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013033280:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366233.919463:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7240 00000100:00100000:3.0:1736366233.919464:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033024 00000100:00100000:0.0:1736366233.919467:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1736366233.919475:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033536 00000100:00100000:0.0:1736366233.919478:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:0.0:1736366233.919480:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013033088:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366233.919480:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1736366233.919483:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:3.0:1736366233.919483:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013033024:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366233.919486:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013033216:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366233.919489:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736366233.919491:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366233.919503:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013033024:12345-0@lo:400:kworker/u8:0.0 Request processed in 20us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366233.919507:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013033088:12345-0@lo:38:kworker/u8:0.0 Request processed in 26us (124us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366233.919507:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1736366233.919510:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:1.0:1736366233.919513:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013033216:12345-0@lo:38:kworker/u8:0.0 Request processed in 27us (103us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366233.919515:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1736366233.919517:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013033536:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366233.919517:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00010000:02000000:0.0:1736366233.919520:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366233.919528:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013033536:12345-0@lo:38:kworker/u8:0.0 Request processed in 11us (82us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366233.919530:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033344 00000100:00100000:0.0:1736366233.919531:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:3.0:1736366233.919541:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77077 00000100:00100000:3.0:1736366233.919543:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a17297c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013033344:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366233.919548:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366233.919560:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a17297c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013033344:12345-0@lo:38:kworker/u8:0.0 Request processed in 17us (133us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366233.919563:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77077 00000100:00080000:3.0:1736366233.919579:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366233.919581:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366233.919583:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013033536:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366233.919588:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366233.919590:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366233.919591:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a569c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013033088:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366233.919597:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366233.919599:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366233.919601:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a568980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013033216:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366233.919606:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1736366233.919607:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366233.919609:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366233.919611:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a568e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013033344:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366233.919631:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013033280:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366233.919636:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033152 00000100:00100000:2.0:1736366233.919643:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013033408:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366233.919653:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013033472:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366233.919654:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1736366233.919656:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a02f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013033152:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366233.919657:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013033024:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366233.919675:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a02f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013033152:12345-0@lo:400:kworker/u8:0.0 Request processed in 18us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366233.919678:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1736366233.919681:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a5684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013033152:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366233.975450:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366234.977509:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366235.979303:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366236.671366:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092a01c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013033600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366236.671415:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366236.671455:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033600 00000100:00100000:2.0:1736366236.671494:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5886 00000100:00100000:2.0:1736366236.671498:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013033600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366236.671521:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366236.671552:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013033600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366236.671569:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5886 00000100:00100000:0.0:1736366236.671570:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092a01c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013033600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366236.687301:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736366236.687316:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073a02600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013033664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366236.687349:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366236.687385:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033664 00000100:00100000:2.0:1736366236.687410:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5887 00000100:00100000:2.0:1736366236.687413:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a02140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013033664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366236.687427:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366236.687455:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a02140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013033664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366236.687459:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5887 00000100:00100000:1.0:1736366236.687488:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073a02600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013033664:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366236.981489:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366237.983377:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366238.704132:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366238.704226:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366238.704271:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366238.704280:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017920 00000100:00100000:3.0:1736366238.704314:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017792 00000100:00100000:2.0:1736366238.704343:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017856 00000100:00100000:3.0:1736366238.704355:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 209 00000100:00100000:0.0:1736366238.704356:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 726 00000100:00100000:3.0:1736366238.704365:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041017792:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366238.704376:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041017920:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366238.704380:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 942 00000100:00100000:2.0:1736366238.704386:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a5684c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041017856:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:2.0:1736366238.704404:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366238.704456:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041017920:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 81us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366238.704457:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a5684c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041017856:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 70us (185us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366238.704459:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041017792:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366238.704464:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 726 00000100:00100000:2.0:1736366238.704470:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 942 00000100:00100000:3.0:1736366238.704470:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 209 00000100:00080000:0.0:1736366238.927334:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366238.927344:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366238.927348:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366238.927358:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8582 00000100:00080000:0.0:1736366238.927362:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366238.927368:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366238.927391:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56f200 x1820703013033792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366238.927414:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366238.927417:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366238.927418:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366238.927421:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8582 00000100:00080000:0.0:1736366238.927422:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366238.927425:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366238.927433:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56f6c0 x1820703013033920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366238.927436:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013033728:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366238.927436:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013033856:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366238.927462:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366238.927465:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366238.927466:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366238.927469:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8582 00000100:00080000:0.0:1736366238.927470:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366238.927485:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366238.927497:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a568980 x1820703013034048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366238.927517:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366238.927520:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366238.927521:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736366238.927522:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366238.927523:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366238.927524:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8582 00000100:00080000:0.0:1736366238.927526:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1736366238.927527:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a568e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013033984:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366238.927528:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366238.927535:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a569300 x1820703013034240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366238.927560:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366238.927563:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a569c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013034112:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366238.927569:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013034176:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366238.927583:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366238.927590:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033728 00000100:00100000:3.0:1736366238.927648:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366238.927666:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033856 00000100:00100000:1.0:1736366238.927680:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034176 00000100:00100000:2.0:1736366238.927687:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1736366238.927688:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013033792:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366238.927695:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013033728:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366238.927701:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033984 00000100:00100000:0.0:1736366238.927716:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1736366238.927718:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7241 00000100:00100000:3.0:1736366238.927719:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366238.927721:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1728980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013033856:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366238.927725:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013034176:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366238.927737:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013033920:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366238.927752:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013033728:12345-0@lo:400:kworker/u8:0.0 Request processed in 58us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366238.927762:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1736366238.927771:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1728980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013033856:12345-0@lo:400:kworker/u8:0.0 Request processed in 50us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366238.927774:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366238.927778:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1736366238.927779:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013034176:12345-0@lo:400:kworker/u8:0.0 Request processed in 54us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366238.927789:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7241 00000100:00100000:3.0:1736366238.927790:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a568980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013034048:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366238.927797:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033792 00000100:00100000:0.0:1736366238.927805:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013033920 00000100:00100000:0.0:1736366238.927812:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1736366238.927814:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013033728:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366238.927816:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a04280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013033984:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366238.927820:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366238.927827:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:1.0:1736366238.927833:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1728e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013033792:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366238.927838:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a569300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013034240:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366238.927841:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a04280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013033984:12345-0@lo:400:kworker/u8:0.0 Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366238.927847:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00010000:02000000:1.0:1736366238.927851:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366238.927862:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:3.0:1736366238.927863:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366238.927868:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013033920:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366238.927869:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034240 00000100:00100000:0.0:1736366238.927878:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:0.0:1736366238.927881:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013034240:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366238.927883:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366238.927889:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1728e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013033792:12345-0@lo:38:kworker/u8:0.0 Request processed in 56us (171us total) trans 0 rc -19/-19 00010000:02000000:0.0:1736366238.927890:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366238.927900:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:3.0:1736366238.927904:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034048 00000100:00100000:0.0:1736366238.927925:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013034240:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (62us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366238.927925:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013033920:12345-0@lo:38:kworker/u8:0.0 Request processed in 55us (151us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366238.927933:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:3.0:1736366238.927933:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77078 00000100:00100000:2.0:1736366238.927937:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:3.0:1736366238.927938:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013034048:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366238.927949:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366238.927955:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366238.927964:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a568e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013033984:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366238.927983:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013034048:12345-0@lo:38:kworker/u8:0.0 Request processed in 44us (163us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366238.927992:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034112 00000100:00100000:3.0:1736366238.927992:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77078 00000100:00100000:1.0:1736366238.928018:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7242 00000100:00100000:1.0:1736366238.928023:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013034112:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366238.928027:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366238.928040:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366238.928046:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013033792:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366238.928058:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366238.928061:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366238.928063:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013033920:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366238.928070:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366238.928072:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366238.928074:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a568980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013034048:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366238.928082:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366238.928084:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366238.928087:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a569300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013034240:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366238.928088:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013034112:12345-0@lo:400:kworker/u8:0.0 Request processed in 63us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366238.928097:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7242 00000100:00100000:3.0:1736366238.928121:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013034176:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366238.928122:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a569c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013034112:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366238.928129:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013033856:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366238.985408:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366239.987399:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366240.989465:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366241.679440:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a569c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013034304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366241.679518:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366241.679667:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034304 00000100:00100000:2.0:1736366241.679731:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5888 00000100:00100000:2.0:1736366241.679737:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013034304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366241.679770:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366241.679834:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013034304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366241.679842:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5888 00000100:00100000:3.0:1736366241.679883:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a569c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013034304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366241.695447:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073a004c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013034368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366241.695490:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366241.695546:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034368 00000100:00100000:2.0:1736366241.695603:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5889 00000100:00100000:2.0:1736366241.695608:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a03900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013034368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366241.695632:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366241.695683:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a03900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013034368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366241.695689:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5889 00000100:00100000:1.0:1736366241.695724:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073a004c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013034368:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366241.991417:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366242.993423:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366243.712416:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366243.712473:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366243.712517:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366243.712596:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018112 00000100:00100000:1.0:1736366243.712603:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018048 00000100:00100000:3.0:1736366243.712636:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041017984 00000100:00100000:1.0:1736366243.712665:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 729 00000100:00100000:2.0:1736366243.712675:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 946 00000100:00100000:1.0:1736366243.712676:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a569c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041018112:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366243.712679:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 211 00000100:00100000:2.0:1736366243.712681:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041018048:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366243.712685:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041017984:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:2.0:1736366243.712699:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366243.712753:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041017984:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 68us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366243.712756:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a569c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041018112:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 80us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366243.712767:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 729 00000100:00100000:2.0:1736366243.712770:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041018048:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 88us (253us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366243.712772:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 211 00000100:00100000:2.0:1736366243.712778:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 946 00000100:00080000:0.0:1736366243.935324:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366243.935331:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366243.935334:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366243.935342:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8587 00000100:00080000:0.0:1736366243.935345:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366243.935351:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366243.935369:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a569300 x1820703013034496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366243.935378:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1736366243.935399:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366243.935400:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013034432:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366243.935402:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366243.935404:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366243.935407:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8587 00000100:00080000:0.0:1736366243.935408:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366243.935411:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366243.935425:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a568980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013034560:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366243.935432:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56f6c0 x1820703013034624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366243.935447:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366243.935450:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366243.935451:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366243.935454:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8587 00000100:00080000:0.0:1736366243.935456:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366243.935459:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366243.935467:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a568e40 x1820703013034752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366243.935475:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366243.935475:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366243.935492:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736366243.935494:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a569300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013034496:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366243.935495:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366243.935496:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366243.935499:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8587 00000100:00080000:0.0:1736366243.935501:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366243.935503:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366243.935511:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a12ac0 x1820703013034944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366243.935519:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736366243.935553:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013034816:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366243.935565:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013034688:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366243.935571:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366243.935584:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034432 00000100:00100000:1.0:1736366243.935591:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366243.935601:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366243.935607:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013034624:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366243.935613:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736366243.935620:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1736366243.935621:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013034880:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366243.935626:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013034432:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366243.935634:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034560 00000100:00100000:3.0:1736366243.935640:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366243.935648:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366243.935662:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034496 00000100:00100000:2.0:1736366243.935672:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034688 00000100:00100000:3.0:1736366243.935679:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a568e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013034752:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366243.935681:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034624 00000100:00100000:0.0:1736366243.935691:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013034432:12345-0@lo:400:kworker/u8:0.0 Request processed in 64us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366243.935691:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1736366243.935696:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a050c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013034560:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366243.935698:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1736366243.935698:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013034432:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366243.935705:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366243.935724:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013034944:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366243.935730:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034816 00000100:00100000:2.0:1736366243.935734:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a050c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013034560:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366243.935738:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034880 00000100:00100000:2.0:1736366243.935742:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:3.0:1736366243.935742:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366243.935755:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034944 00000100:00100000:1.0:1736366243.935761:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7243 00000100:00100000:2.0:1736366243.935763:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:0.0:1736366243.935765:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7244 00000100:00100000:1.0:1736366243.935766:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a03dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013034816:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366243.935767:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a076c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013034688:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366243.935771:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013034752 00000100:00100000:0.0:1736366243.935778:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a004c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013034880:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366243.935789:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a076c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013034688:12345-0@lo:400:kworker/u8:0.0 Request processed in 22us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366243.935793:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77079 00000100:00100000:2.0:1736366243.935795:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:3.0:1736366243.935798:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013034752:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366243.935803:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:2.0:1736366243.935806:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013034496:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366243.935808:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a03dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013034816:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (218us total) trans 0 rc 0/0 00010000:02000000:3.0:1736366243.935812:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366243.935813:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a004c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013034880:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366243.935815:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7243 00010000:02000000:2.0:1736366243.935815:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366243.935819:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7244 00000100:00100000:3.0:1736366243.935840:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013034752:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (135us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366243.935845:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:3.0:1736366243.935847:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77079 00000100:00100000:1.0:1736366243.935849:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013034624:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366243.935852:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013034496:12345-0@lo:38:kworker/u8:0.0 Request processed in 45us (282us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366243.935856:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:2.0:1736366243.935861:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:0.0:1736366243.935862:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013034944:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366243.935871:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736366243.935875:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736366243.935880:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366243.935883:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366243.935887:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a569300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013034496:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366243.935895:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366243.935896:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013034688:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366243.935897:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366243.935900:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a568e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013034752:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366243.935901:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013034624:12345-0@lo:38:kworker/u8:0.0 Request processed in 52us (263us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366243.935906:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a568980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013034560:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366243.935908:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:0.0:1736366243.935914:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013034944:12345-0@lo:38:kworker/u8:0.0 Request processed in 51us (170us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736366243.935919:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366243.935924:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00080000:3.0:1736366243.935930:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366243.935933:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013034944:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366243.935939:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013034880:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366243.935945:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366243.935947:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366243.935948:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013034816:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366243.935950:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013034624:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366243.995396:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366244.997404:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:0.0:1736366245.555309:0:17953:0:(genops.c:1786:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 64 seconds. The obd refcount = 4. Is it stuck? 00000020:02000400:0.0:1736366245.560406:0:17953:0:(genops.c:1752:print_export_data()) lustre-MDT0000: UNLINKED ffff88012c763800 cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 192.168.201.2@tcp 1 (0 0 0) 1 0 1 0: (null) 536870912003 stale:0 00010000:00010000:2.0:1736366245.999434:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366246.687544:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800745184c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013035008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366246.687616:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366246.687687:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035008 00000100:00100000:0.0:1736366246.687751:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5890 00000100:00100000:0.0:1736366246.687757:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a06d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013035008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366246.687791:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366246.687859:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a06d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013035008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366246.687867:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5890 00000100:00100000:2.0:1736366246.687901:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800745184c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013035008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366246.703470:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073a03440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013035072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366246.703535:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366246.703626:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035072 00000100:00100000:1.0:1736366246.703670:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5891 00000100:00100000:1.0:1736366246.703675:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a10e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013035072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736366246.703698:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:1.0:1736366246.703754:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a10e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013035072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366246.703761:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5891 00000100:00100000:0.0:1736366246.703799:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073a03440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013035072:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366247.001515:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366248.003409:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366248.720044:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366248.720079:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366248.720108:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366248.720110:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018304 00000100:00100000:1.0:1736366248.720136:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018176 00000100:00100000:0.0:1736366248.720140:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018240 00000100:00100000:2.0:1736366248.720154:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 732 00000100:00100000:0.0:1736366248.720158:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 950 00000100:00100000:2.0:1736366248.720159:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a12f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041018304:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366248.720184:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a16d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041018240:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:1.0:1736366248.720188:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 213 00000100:00100000:1.0:1736366248.720192:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041018176:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:0.0:1736366248.720196:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366248.720236:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a12f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041018304:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366248.720237:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a16d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041018240:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 75us (129us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366248.720237:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041018176:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 44us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366248.720243:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 213 00000100:00100000:2.0:1736366248.720243:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 732 00000100:00100000:0.0:1736366248.720245:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 950 00000100:00080000:0.0:1736366248.943348:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366248.943355:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366248.943359:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366248.943365:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8592 00000100:00080000:0.0:1736366248.943369:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366248.943375:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366248.943394:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a17200 x1820703013035200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366248.943402:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a176c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013035136:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366248.943420:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366248.943423:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366248.943424:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366248.943428:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8592 00000100:00080000:0.0:1736366248.943429:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366248.943432:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366248.943440:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a14280 x1820703013035328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366248.943486:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a15580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013035264:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366248.943489:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366248.943492:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366248.943503:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366248.943503:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366248.943506:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8592 00000100:00080000:0.0:1736366248.943508:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366248.943512:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366248.943521:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013035200:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366248.943525:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a104c0 x1820703013035456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366248.943546:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736366248.943547:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366248.943549:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366248.943550:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366248.943553:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8592 00000100:00080000:0.0:1736366248.943555:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366248.943557:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366248.943564:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a13dc0 x1820703013035648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366248.943567:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366248.943570:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035136 00000100:00100000:2.0:1736366248.943578:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736366248.943584:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013035584:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366248.943588:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013035520:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366248.943590:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a14280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013035328:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366248.943606:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1736366248.943609:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366248.943612:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013035136:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366248.943615:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366248.943625:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366248.943632:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013035456:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366248.943640:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035264 00000100:00100000:0.0:1736366248.943647:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366248.943653:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013035392:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366248.943654:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366248.943666:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035200 00000100:00100000:3.0:1736366248.943667:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013035648:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366248.943675:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366248.943677:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035328 00000100:00100000:1.0:1736366248.943678:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013035136:12345-0@lo:400:kworker/u8:0.0 Request processed in 64us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366248.943685:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035392 00000100:00100000:1.0:1736366248.943690:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1736366248.943710:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1736366248.943715:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a07200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013035264:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366248.943717:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035584 00000100:00100000:3.0:1736366248.943724:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:3.0:1736366248.943731:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013035392:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366248.943738:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035520 00000100:00100000:0.0:1736366248.943744:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7245 00000100:00100000:0.0:1736366248.943749:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a03440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013035584:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366248.943759:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a07200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013035264:12345-0@lo:400:kworker/u8:0.0 Request processed in 44us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366248.943766:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:1.0:1736366248.943768:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7246 00000100:00100000:1.0:1736366248.943773:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a10980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013035520:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366248.943776:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013035392:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366248.943780:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1736366248.943787:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a03440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013035584:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366248.943787:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1736366248.943788:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074518980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013035200:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366248.943793:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7245 00010000:02000000:2.0:1736366248.943800:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366248.943805:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:3.0:1736366248.943808:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074518e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013035328:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366248.943819:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a10980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013035520:12345-0@lo:400:kworker/u8:0.0 Request processed in 44us (193us total) trans 0 rc 0/0 00010000:02000000:3.0:1736366248.943819:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366248.943822:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366248.943825:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074518980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013035200:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (259us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366248.943829:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7246 00000100:00100000:2.0:1736366248.943831:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:2.0:1736366248.943840:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035648 00000100:00100000:3.0:1736366248.943843:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074518e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013035328:12345-0@lo:38:kworker/u8:0.0 Request processed in 33us (228us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366248.943849:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:2.0:1736366248.943852:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a16880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013035648:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366248.943857:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1736366248.943859:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366248.943862:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366248.943864:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:0.0:1736366248.943866:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013035200:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366248.943874:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a176c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013035136:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366248.943875:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a16880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013035648:12345-0@lo:38:kworker/u8:0.0 Request processed in 22us (53us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736366248.943877:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366248.943879:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366248.943881:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a14280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013035328:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366248.943881:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:3.0:1736366248.943886:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035456 00000100:00080000:0.0:1736366248.943902:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366248.943904:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77080 00000100:00080000:0.0:1736366248.943905:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366248.943907:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013035648:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366248.943908:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074519300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013035456:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366248.943915:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366248.943918:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013035584:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366248.943928:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a15580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013035264:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366248.943940:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013035392:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366248.943944:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074519300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013035456:12345-0@lo:38:kworker/u8:0.0 Request processed in 35us (290us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366248.943950:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77080 00000100:00100000:1.0:1736366248.943954:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013035520:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366248.943979:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366248.943983:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366248.943988:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013035456:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366249.005385:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366250.007421:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366251.009496:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366251.695509:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800745197c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013035712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366251.695583:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366251.695661:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035712 00000100:00100000:1.0:1736366251.695736:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5892 00000100:00100000:1.0:1736366251.695746:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a004c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013035712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1736366251.695782:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736366251.695867:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a004c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013035712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366251.695880:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5892 00000100:00100000:2.0:1736366251.695894:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800745197c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013035712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366251.711440:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013035776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366251.711480:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366251.711531:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035776 00000100:00100000:1.0:1736366251.711566:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5893 00000100:00100000:1.0:1736366251.711571:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a02600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013035776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736366251.711594:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:1.0:1736366251.711635:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a02600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013035776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366251.711652:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013035776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366251.711653:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5893 00010000:00010000:1.0:1736366252.011388:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366253.013460:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366253.728307:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366253.728358:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366253.728452:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366253.728477:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018496 00000100:00100000:1.0:1736366253.728531:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018368 00000100:00100000:2.0:1736366253.728540:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018432 00000100:00100000:2.0:1736366253.728560:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 735 00000100:00100000:2.0:1736366253.728567:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a13dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041018496:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366253.728572:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 215 00000100:00100000:1.0:1736366253.728578:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041018368:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366253.728631:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 954 00000100:00100000:3.0:1736366253.728642:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a14280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041018432:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:1.0:1736366253.728656:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041018368:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 77us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366253.728660:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a13dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041018496:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 94us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366253.728664:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 215 00010000:02000000:3.0:1736366253.728666:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366253.728668:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 735 00000100:00100000:3.0:1736366253.728718:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a14280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041018432:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 76us (267us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366253.728729:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 954 00000100:00080000:0.0:1736366253.951298:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366253.951307:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366253.951311:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366253.951319:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8597 00000100:00080000:0.0:1736366253.951324:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366253.951330:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366253.951343:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013035840:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366253.951355:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a163c0 x1820703013035904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366253.951431:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366253.951436:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366253.951449:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366253.951451:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366253.951457:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8597 00000100:00080000:0.0:1736366253.951461:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00100000:2.0:1736366253.951463:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1736366253.951466:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366253.951482:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a11c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013035968:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366253.951484:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035840 00000100:00100000:0.0:1736366253.951486:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a12140 x1820703013036032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366253.951507:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a163c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013035904:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366253.951518:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366253.951522:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1736366253.951522:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00080000:0.0:1736366253.951524:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736366253.951525:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366253.951528:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013035840:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366253.951529:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8597 00000100:00080000:0.0:1736366253.951532:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366253.951536:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366253.951551:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366253.951552:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a13440 x1820703013036160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366253.951552:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013036096:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366253.951577:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013036032:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366253.951577:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366253.951584:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736366253.951584:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013035840:12345-0@lo:400:kworker/u8:0.0 Request processed in 56us (150us total) trans 0 rc 0/0 00000100:00080000:0.0:1736366253.951588:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366253.951590:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736366253.951590:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:0.0:1736366253.951594:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8597 00000100:00080000:0.0:1736366253.951597:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366253.951601:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366253.951606:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035968 00000100:00100000:1.0:1736366253.951609:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366253.951615:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a104c0 x1820703013036352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366253.951633:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013035904 00000100:00100000:3.0:1736366253.951634:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036096 00000100:00100000:1.0:1736366253.951636:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013036160:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366253.951646:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036032 00000100:00100000:3.0:1736366253.951650:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:3.0:1736366253.951654:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013035968:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366253.951658:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:2.0:1736366253.951663:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a03900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013036096:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366253.951667:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013036224:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366253.951667:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366253.951684:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013036352:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366253.951686:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013035968:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366253.951703:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1736366253.951708:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a03900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013036096:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366253.951715:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:1.0:1736366253.951719:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366253.951719:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1736366253.951720:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366253.951722:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a07200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013035904:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366253.951727:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036352 00010000:02000000:3.0:1736366253.951735:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366253.951736:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1736366253.951747:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036160 00000100:00100000:2.0:1736366253.951750:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a017c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013036032:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366253.951761:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366253.951766:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a07200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013035904:12345-0@lo:38:kworker/u8:0.0 Request processed in 43us (217us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366253.951767:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736366253.951772:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1736366253.951775:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a15f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013036288:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366253.951778:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77081 00000100:00100000:3.0:1736366253.951782:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:3.0:1736366253.951785:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a01c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013036352:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366253.951787:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a01300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013036160:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366253.951787:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a017c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013036032:12345-0@lo:38:kworker/u8:0.0 Request processed in 37us (180us total) trans 0 rc -19/-19 00010000:02000000:3.0:1736366253.951791:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366253.951794:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00010000:02000000:1.0:1736366253.951801:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366253.951807:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366253.951810:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a01c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013036352:12345-0@lo:38:kworker/u8:0.0 Request processed in 24us (92us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366253.951815:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1736366253.951842:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036224 00000100:00100000:1.0:1736366253.951843:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a01300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013036160:12345-0@lo:38:kworker/u8:0.0 Request processed in 57us (176us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366253.951870:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77081 00000100:00100000:0.0:1736366253.951876:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036288 00000100:00100000:0.0:1736366253.951900:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7247 00000100:00100000:2.0:1736366253.951902:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013036096:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366253.951908:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a13900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013036224:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366253.951913:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a11c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013035968:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366253.951917:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013035840:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366253.951964:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7248 00000100:00100000:2.0:1736366253.951968:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013036288:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366253.952115:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366253.952119:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366253.952124:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013036160:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366253.952136:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013036288:12345-0@lo:400:kworker/u8:0.0 Request processed in 167us (329us total) trans 0 rc 0/0 00000100:00080000:1.0:1736366253.952139:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366253.952142:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366253.952142:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7248 00000100:00100000:1.0:1736366253.952145:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013036352:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366253.952157:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366253.952200:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a13900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013036224:12345-0@lo:400:kworker/u8:0.0 Request processed in 255us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366253.952212:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7247 00000100:00080000:1.0:1736366253.952225:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366253.952232:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a163c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013035904:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366253.952249:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366253.952252:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366253.952256:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013036032:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366253.952270:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a15f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013036288:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366253.952289:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013036224:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366254.015426:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366255.017394:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366256.019400:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366256.703554:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013036416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366256.703637:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366256.703737:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036416 00000100:00100000:1.0:1736366256.703796:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5894 00000100:00100000:1.0:1736366256.703802:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a15580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013036416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1736366256.703835:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:1.0:1736366256.703895:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a15580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013036416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366256.703902:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5894 00000100:00100000:0.0:1736366256.703968:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013036416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366256.719413:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9ca600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013036480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366256.719457:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366256.719551:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036480 00000100:00100000:1.0:1736366256.719606:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5895 00000100:00100000:1.0:1736366256.719629:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074519c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013036480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1736366256.719659:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:1.0:1736366256.719726:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074519c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013036480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366256.719737:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5895 00000100:00100000:3.0:1736366256.719763:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9ca600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013036480:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366257.021387:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366258.023379:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366258.736278:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366258.736382:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366258.736439:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366258.736484:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018624 00000100:00100000:2.0:1736366258.736485:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018688 00000100:00100000:3.0:1736366258.736515:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018560 00000100:00100000:0.0:1736366258.736521:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 738 00000100:00100000:0.0:1736366258.736528:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a14c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041018688:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366258.736535:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 958 00000100:00100000:2.0:1736366258.736541:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041018624:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366258.736557:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 217 00010000:02000000:2.0:1736366258.736558:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366258.736563:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041018560:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366258.736613:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a14c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041018688:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 85us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366258.736616:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041018624:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 74us (177us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366258.736620:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041018560:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 56us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366258.736622:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 738 00000100:00100000:2.0:1736366258.736626:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 958 00000100:00100000:3.0:1736366258.736642:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 217 00000100:00080000:0.0:1736366258.959357:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366258.959365:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366258.959370:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366258.959378:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8602 00000100:00080000:0.0:1736366258.959393:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366258.959400:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366258.959420:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366258.959426:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a150c0 x1820703013036608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366258.959445:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013036544:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366258.959482:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366258.959488:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366258.959489:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366258.959494:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8602 00000100:00080000:0.0:1736366258.959496:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366258.959501:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366258.959503:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736366258.959513:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a15f00 x1820703013036736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366258.959519:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013036672:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366258.959527:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366258.959544:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366258.959548:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366258.959550:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366258.959554:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8602 00000100:00080000:0.0:1736366258.959557:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366258.959562:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366258.959566:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366258.959577:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a163c0 x1820703013036864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366258.959593:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013036608:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366258.959594:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736366258.959601:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013036800:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366258.959618:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366258.959623:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366258.959625:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366258.959629:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8602 00000100:00100000:3.0:1736366258.959630:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366258.959632:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:1.0:1736366258.959637:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1736366258.959647:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366258.959649:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013036928:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366258.959650:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013036992:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366258.959666:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a17200 x1820703013037056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366258.959668:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036544 00000100:00100000:3.0:1736366258.959668:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366258.959689:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366258.959709:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036928 00000100:00100000:0.0:1736366258.959714:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036672 00000100:00100000:2.0:1736366258.959717:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1736366258.959723:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013036544:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366258.959725:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366258.959742:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a15f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013036736:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366258.959746:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036992 00000100:00100000:0.0:1736366258.959752:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036800 00000100:00100000:3.0:1736366258.959771:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7249 00000100:00100000:0.0:1736366258.959772:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036608 00000100:00100000:1.0:1736366258.959775:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366258.959778:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013036928:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366258.959784:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013036544:12345-0@lo:400:kworker/u8:0.0 Request processed in 61us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366258.959799:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a163c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013036864:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366258.959800:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036736 00000100:00100000:2.0:1736366258.959801:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1736366258.959817:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:0.0:1736366258.959824:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013036672:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366258.959833:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013036928:12345-0@lo:400:kworker/u8:0.0 Request processed in 55us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366258.959835:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366258.959840:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7249 00000100:00100000:2.0:1736366258.959844:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7250 00000100:00100000:2.0:1736366258.959849:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013036992:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366258.959855:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013037056:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366258.959882:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013036928:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366258.959890:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013036672:12345-0@lo:400:kworker/u8:0.0 Request processed in 64us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366258.959892:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013036992:12345-0@lo:400:kworker/u8:0.0 Request processed in 43us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366258.959898:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366258.959898:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7250 00000100:00100000:0.0:1736366258.959901:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1736366258.959906:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013036672:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366258.959923:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037056 00000100:00100000:0.0:1736366258.959930:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:0.0:1736366258.959937:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013036800:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366258.959939:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013036864 00000100:00100000:1.0:1736366258.959949:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1736366258.959956:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013036608:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366258.959956:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77082 00000100:00100000:2.0:1736366258.959962:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:3.0:1736366258.959962:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013036864:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366258.959966:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a568980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013036736:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366258.959975:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736366258.959975:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366258.959976:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366258.959988:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013036800:12345-0@lo:400:kworker/u8:0.0 Request processed in 50us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366258.959996:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1736366258.960011:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a568980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013036736:12345-0@lo:38:kworker/u8:0.0 Request processed in 44us (238us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366258.960017:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:2.0:1736366258.960023:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:3.0:1736366258.960023:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013036864:12345-0@lo:38:kworker/u8:0.0 Request processed in 61us (188us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366258.960025:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a568e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013037056:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366258.960034:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013036608:12345-0@lo:38:kworker/u8:0.0 Request processed in 77us (307us total) trans 0 rc -19/-19 00010000:02000000:0.0:1736366258.960038:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366258.960044:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77082 00000100:00080000:2.0:1736366258.960055:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366258.960058:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366258.960062:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a163c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013036864:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366258.960063:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:0.0:1736366258.960072:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a568e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013037056:12345-0@lo:38:kworker/u8:0.0 Request processed in 48us (174us total) trans 0 rc -19/-19 00000100:00080000:2.0:1736366258.960074:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366258.960077:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366258.960078:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013036800:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366258.960079:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013037056:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366258.960083:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00080000:2.0:1736366258.960088:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366258.960090:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366258.960092:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013036608:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366258.960099:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366258.960101:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366258.960110:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a15f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013036736:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366258.960118:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013036992:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366258.960131:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013036544:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366259.025385:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366260.027426:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366261.029441:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366261.711557:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a11c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013037120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366261.711642:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366261.711798:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037120 00000100:00100000:2.0:1736366261.711863:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5896 00000100:00100000:2.0:1736366261.711870:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a569300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013037120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366261.711903:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366261.711966:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a569300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013037120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366261.711974:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5896 00000100:00100000:1.0:1736366261.712020:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a11c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013037120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366261.727448:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007451f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013037184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366261.727490:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366261.727546:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037184 00000100:00100000:2.0:1736366261.727581:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5897 00000100:00100000:2.0:1736366261.727586:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a14740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013037184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366261.727611:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366261.727668:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a14740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013037184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366261.727675:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5897 00000100:00100000:0.0:1736366261.727726:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007451f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013037184:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366262.031403:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366263.033404:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366263.744341:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366263.744417:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366263.744483:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366263.744504:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018880 00000100:00100000:0.0:1736366263.744542:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018816 00000100:00100000:3.0:1736366263.744553:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018752 00000100:00100000:2.0:1736366263.744576:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 741 00000100:00100000:2.0:1736366263.744584:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a11c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041018880:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366263.744585:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 962 00000100:00100000:0.0:1736366263.744592:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a12ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041018816:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366263.744595:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 219 00000100:00100000:3.0:1736366263.744601:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041018752:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:0.0:1736366263.744613:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366263.744663:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a11c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041018880:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 78us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366263.744664:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041018752:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 60us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366263.744668:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a12ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041018816:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 74us (186us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366263.744673:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 219 00000100:00100000:2.0:1736366263.744674:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 741 00000100:00100000:0.0:1736366263.744679:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 962 00000100:00080000:0.0:1736366263.967345:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366263.967351:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366263.967355:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366263.967361:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8607 00000100:00080000:0.0:1736366263.967366:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366263.967371:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366263.967389:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a15f00 x1820703013037312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366263.967407:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1736366263.967423:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366263.967426:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366263.967427:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366263.967428:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013037248:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366263.967431:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8607 00000100:00080000:0.0:1736366263.967433:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366263.967435:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366263.967443:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a17200 x1820703013037440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366263.967458:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013037376:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366263.967470:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366263.967473:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366263.967474:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366263.967476:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8607 00000100:00080000:0.0:1736366263.967478:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366263.967481:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366263.967490:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a12140 x1820703013037568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366263.967498:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366263.967511:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366263.967514:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1736366263.967514:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a15f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013037312:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366263.967515:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736366263.967515:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366263.967518:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8607 00000100:00080000:0.0:1736366263.967520:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366263.967522:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366263.967531:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013037632:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366263.967532:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f4740 x1820703013037760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366263.967558:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736366263.967563:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037376 00000100:00100000:2.0:1736366263.967565:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a163c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013037504:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366263.967570:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366263.967581:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366263.967591:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366263.967592:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037312 00000100:00100000:3.0:1736366263.967594:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013037440:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366263.967601:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736366263.967603:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037504 00000100:00100000:1.0:1736366263.967610:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013037696:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366263.967612:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366263.967618:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037440 00000100:00100000:3.0:1736366263.967621:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013037568:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366263.967627:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1736366263.967633:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013037376:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366263.967639:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1736366263.967641:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366263.967644:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9caac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013037504:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366263.967646:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366263.967666:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013037760:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366263.967677:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013037376:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366263.967685:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:3.0:1736366263.967685:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366263.967690:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9caac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013037504:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366263.967700:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:0.0:1736366263.967706:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1736366263.967708:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013037312:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366263.967710:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037760 00000100:00100000:3.0:1736366263.967711:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037248 00000100:00100000:2.0:1736366263.967724:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00010000:02000000:1.0:1736366263.967725:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366263.967728:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013037440:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366263.967736:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1736366263.967737:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00010000:02000000:2.0:1736366263.967738:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366263.967740:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013037760:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366263.967742:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013037248:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:0.0:1736366263.967750:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366263.967774:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013037312:12345-0@lo:38:kworker/u8:0.0 Request processed in 67us (204us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366263.967780:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013037440:12345-0@lo:38:kworker/u8:0.0 Request processed in 51us (167us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366263.967785:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:3.0:1736366263.967788:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013037248:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366263.967789:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013037760:12345-0@lo:38:kworker/u8:0.0 Request processed in 48us (104us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366263.967790:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:0.0:1736366263.967797:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1736366263.967797:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1736366263.967817:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037632 00000100:00100000:2.0:1736366263.967839:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037696 00000100:00100000:3.0:1736366263.967843:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7251 00000100:00100000:3.0:1736366263.967847:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013037632:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366263.967854:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7252 00000100:00080000:0.0:1736366263.967859:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736366263.967860:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013037248:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366263.967860:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d241c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013037696:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366263.967863:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366263.967869:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013037760:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366263.967877:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013037632:12345-0@lo:400:kworker/u8:0.0 Request processed in 29us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366263.967882:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7251 00000100:00080000:0.0:1736366263.967885:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366263.967888:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366263.967892:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a15f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013037312:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366263.967892:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d241c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013037696:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366263.967894:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013037632:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366263.967899:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7252 00000100:00100000:3.0:1736366263.967903:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037568 00000100:00080000:0.0:1736366263.967905:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366263.967908:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366263.967912:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013037440:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366263.967918:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77083 00000100:00100000:3.0:1736366263.967921:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880080b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013037568:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366263.967928:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a163c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013037504:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366263.967930:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013037696:0@lo:400:kworker/u8:0.0 00010000:02000000:3.0:1736366263.967930:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366263.967938:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013037376:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366263.967971:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880080b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013037568:12345-0@lo:38:kworker/u8:0.0 Request processed in 49us (324us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366263.967977:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77083 00000100:00080000:0.0:1736366263.967989:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366263.967992:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366263.967995:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013037568:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366264.035403:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366265.037398:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366266.039409:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366266.719539:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736366266.719566:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013037824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366266.719634:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366266.719699:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037824 00000100:00100000:2.0:1736366266.719761:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5898 00000100:00100000:2.0:1736366266.719767:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d2450c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013037824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366266.719800:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366266.719868:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d2450c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013037824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366266.719876:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5898 00000100:00100000:1.0:1736366266.719909:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013037824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366266.735334:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013037888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366266.735372:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366266.735514:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037888 00000100:00100000:3.0:1736366266.735565:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5899 00000100:00100000:3.0:1736366266.735571:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d246880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013037888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1736366266.735594:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:3.0:1736366266.735648:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d246880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013037888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366266.735655:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5899 00000100:00100000:1.0:1736366266.735687:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013037888:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366267.041379:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366268.043397:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366268.752304:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366268.752354:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366268.752395:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366268.752454:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019072 00000100:00100000:3.0:1736366268.752480:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041018944 00000100:00100000:2.0:1736366268.752518:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019008 00000100:00100000:3.0:1736366268.752524:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 221 00000100:00100000:3.0:1736366268.752531:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041018944:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366268.752536:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 744 00000100:00100000:1.0:1736366268.752545:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041019072:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366268.752547:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 966 00000100:00100000:2.0:1736366268.752553:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041019008:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:2.0:1736366268.752571:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366268.752603:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041018944:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 71us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366268.752604:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041019072:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 60us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366268.752612:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 744 00000100:00100000:2.0:1736366268.752618:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041019008:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 64us (223us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366268.752625:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 966 00000100:00100000:3.0:1736366268.752628:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 221 00000100:00080000:0.0:1736366268.975291:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366268.975297:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366268.975301:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366268.975315:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8612 00000100:00080000:0.0:1736366268.975319:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366268.975324:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366268.975340:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013037952:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366268.975343:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f5f00 x1820703013038016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366268.975366:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366268.975369:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366268.975370:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366268.975373:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8612 00000100:00080000:0.0:1736366268.975374:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366268.975377:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366268.975384:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f4280 x1820703013038144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366268.975390:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013038080:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366268.975398:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366268.975402:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366268.975405:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366268.975406:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366268.975408:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8612 00000100:00080000:0.0:1736366268.975410:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366268.975413:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366268.975421:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f3dc0 x1820703013038272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366268.975438:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366268.975441:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366268.975442:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366268.975445:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8612 00000100:00100000:1.0:1736366268.975451:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013038400:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366268.975451:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366268.975452:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366268.975455:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366268.975465:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f0980 x1820703013038464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366268.975479:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366268.975488:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013038016:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366268.975496:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038080 00000100:00100000:1.0:1736366268.975509:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013038336:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366268.975524:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366268.975525:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013037952 00000100:00100000:1.0:1736366268.975528:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366268.975529:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:2.0:1736366268.975534:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013038080:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366268.975541:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366268.975542:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013038144:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366268.975547:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f3440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013038208:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366268.975559:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366268.975564:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1736366268.975569:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366268.975570:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013038272:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366268.975571:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013037952:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366268.975577:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013038080:12345-0@lo:400:kworker/u8:0.0 Request processed in 43us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366268.975584:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:2.0:1736366268.975597:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038016 00000100:00100000:1.0:1736366268.975606:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038144 00000100:00100000:2.0:1736366268.975609:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038208 00000100:00100000:2.0:1736366268.975618:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:2.0:1736366268.975621:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d2463c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013038208:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366268.975621:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013037952:12345-0@lo:400:kworker/u8:0.0 Request processed in 51us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366268.975629:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:3.0:1736366268.975629:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1736366268.975634:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013038016:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366268.975643:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:1.0:1736366268.975647:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366268.975657:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013038464:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366268.975666:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038272 00000100:00100000:2.0:1736366268.975669:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d2463c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013038208:12345-0@lo:400:kworker/u8:0.0 Request processed in 47us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366268.975676:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1736366268.975678:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366268.975678:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013038016:12345-0@lo:38:kworker/u8:0.0 Request processed in 44us (154us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366268.975682:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77084 00000100:00100000:1.0:1736366268.975685:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:3.0:1736366268.975686:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f2140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013038272:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366268.975687:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038464 00000100:00100000:2.0:1736366268.975696:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00010000:02000000:3.0:1736366268.975696:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366268.975700:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1736366268.975701:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013038144:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366268.975702:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736366268.975704:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013038464:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366268.975706:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366268.975710:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013038016:0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366268.975710:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366268.975711:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1736366268.975719:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366268.975720:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f2140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013038272:12345-0@lo:38:kworker/u8:0.0 Request processed in 33us (77us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736366268.975721:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366268.975724:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013038272:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366268.975726:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77084 00000100:00080000:0.0:1736366268.975731:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366268.975733:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366268.975733:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013038464:12345-0@lo:38:kworker/u8:0.0 Request processed in 29us (55us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366268.975735:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013038464:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366268.975736:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013038144:12345-0@lo:38:kworker/u8:0.0 Request processed in 35us (176us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366268.975738:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1736366268.975742:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:3.0:1736366268.975760:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038400 00000100:00080000:0.0:1736366268.975761:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366268.975763:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366268.975768:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f3440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013038208:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366268.975773:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013038144:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366268.975773:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013038080:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366268.975778:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038336 00000100:00100000:1.0:1736366268.975791:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013037952:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366268.975792:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7253 00000100:00100000:3.0:1736366268.975796:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d2417c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013038400:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366268.975800:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7254 00000100:00100000:2.0:1736366268.975804:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013038336:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366268.975827:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d2417c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013038400:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366268.975832:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013038400:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366268.975833:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7253 00000100:00100000:2.0:1736366268.975837:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013038336:12345-0@lo:400:kworker/u8:0.0 Request processed in 33us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366268.975843:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7254 00000100:00100000:0.0:1736366268.975868:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013038336:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366269.045410:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366270.047404:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366271.049409:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366271.727534:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736366271.727559:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013038528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366271.727626:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366271.727755:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038528 00000100:00100000:3.0:1736366271.727816:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5900 00000100:00100000:3.0:1736366271.727822:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d244c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013038528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1736366271.727856:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736366271.727933:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d244c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013038528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366271.727942:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5900 00000100:00100000:1.0:1736366271.727980:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013038528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366271.743413:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d242f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013038592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366271.743461:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366271.743585:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038592 00000100:00100000:3.0:1736366271.743633:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5901 00000100:00100000:3.0:1736366271.743638:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013038592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1736366271.743662:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:3.0:1736366271.743714:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013038592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366271.743722:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5901 00000100:00100000:2.0:1736366271.743757:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d242f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013038592:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366272.051398:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366273.053385:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366273.760294:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366273.760363:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366273.760421:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366273.760467:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019264 00000100:00100000:3.0:1736366273.760492:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019136 00000100:00100000:2.0:1736366273.760527:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019200 00000100:00100000:3.0:1736366273.760534:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 223 00000100:00100000:3.0:1736366273.760542:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041019136:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366273.760545:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 747 00000100:00100000:2.0:1736366273.760551:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041019264:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366273.760568:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 970 00000100:00100000:1.0:1736366273.760578:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041019200:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366273.760600:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366273.760614:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041019136:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 72us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366273.760615:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041019264:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 62us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366273.760623:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 747 00000100:00100000:3.0:1736366273.760623:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 223 00000100:00100000:1.0:1736366273.760648:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041019200:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 70us (229us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366273.760673:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 970 00000100:00080000:0.0:1736366273.983321:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366273.983327:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366273.983330:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366273.983336:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8617 00000100:00080000:0.0:1736366273.983339:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366273.983345:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366273.983363:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f5f00 x1820703013038720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366273.983395:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366273.983399:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366273.983400:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366273.983403:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8617 00000100:00080000:0.0:1736366273.983405:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366273.983408:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366273.983416:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f1300 x1820703013038848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366273.983429:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736366273.983430:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013038656:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366273.983431:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366273.983432:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366273.983434:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013038784:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366273.983435:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8617 00000100:00080000:0.0:1736366273.983446:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366273.983449:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366273.983460:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f2f80 x1820703013038976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366273.983478:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366273.983481:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366273.983482:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366273.983484:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366273.983485:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8617 00000100:00080000:0.0:1736366273.983486:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00100000:2.0:1736366273.983487:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366273.983489:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366273.983495:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f2600 x1820703013039168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366273.983502:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013038912:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366273.983517:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013038720:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366273.983517:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013039104:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366273.983529:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038784 00000100:00100000:2.0:1736366273.983546:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366273.983547:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366273.983559:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736366273.983565:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013039040:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366273.983566:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038912 00000100:00100000:1.0:1736366273.983582:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1736366273.983586:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d244740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013038784:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366273.983590:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:2.0:1736366273.983597:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366273.983598:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013038912:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366273.983612:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038656 00000100:00100000:2.0:1736366273.983626:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039104 00000100:00100000:1.0:1736366273.983629:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d244740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013038784:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366273.983635:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:3.0:1736366273.983638:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1736366273.983641:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013038912:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366273.983643:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013038656:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366273.983647:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:2.0:1736366273.983651:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039040 00000100:00100000:2.0:1736366273.983667:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7255 00000100:00100000:2.0:1736366273.983672:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cf200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013039104:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366273.983673:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013038784:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366273.983674:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7256 00000100:00100000:3.0:1736366273.983678:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013038656:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366273.983679:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cd580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013039040:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366273.983685:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1736366273.983706:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cd580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013039040:12345-0@lo:400:kworker/u8:0.0 Request processed in 27us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366273.983709:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cf200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013039104:12345-0@lo:400:kworker/u8:0.0 Request processed in 36us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366273.983712:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7256 00000100:00100000:2.0:1736366273.983716:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7255 00000100:00100000:3.0:1736366273.983728:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013038912:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366273.983731:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366273.983746:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013038848:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366273.983746:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013039040:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366273.983755:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013039104:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366273.983760:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038720 00000100:00100000:2.0:1736366273.983762:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013038656:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366273.983776:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:0.0:1736366273.983777:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366273.983779:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013038720:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366273.983788:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013038976:0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366273.983791:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366273.983805:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366273.983818:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013038720:12345-0@lo:38:kworker/u8:0.0 Request processed in 37us (86us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366273.983824:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:0.0:1736366273.983828:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013039168:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366273.983832:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038848 00000100:00100000:1.0:1736366273.983843:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:0.0:1736366273.983846:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366273.983846:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013038848:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366273.983852:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366273.983862:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013038976 00000100:00100000:1.0:1736366273.983870:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013038848:12345-0@lo:38:kworker/u8:0.0 Request processed in 23us (93us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736366273.983872:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366273.983874:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366273.983875:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:0.0:1736366273.983878:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013038720:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366273.983886:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366273.983888:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366273.983890:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013038848:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366273.983896:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039168 00000100:00100000:3.0:1736366273.983896:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77085 00000100:00100000:3.0:1736366273.983901:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013038976:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366273.983908:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:1.0:1736366273.983910:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013039168:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366273.983912:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736366273.983917:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366273.983951:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013039168:12345-0@lo:38:kworker/u8:0.0 Request processed in 40us (106us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366273.983951:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013038976:12345-0@lo:38:kworker/u8:0.0 Request processed in 49us (145us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366273.983957:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1736366273.983957:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77085 00000100:00080000:0.0:1736366273.983963:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366273.983966:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366273.983968:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013038976:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366273.983975:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366273.983978:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366273.983980:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013039168:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366274.055402:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366275.057386:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366276.059408:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366276.735486:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d243440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013039232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366276.735557:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366276.735637:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039232 00000100:00100000:3.0:1736366276.735701:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5902 00000100:00100000:3.0:1736366276.735708:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013039232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1736366276.735742:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736366276.735804:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013039232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366276.735812:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5902 00000100:00100000:2.0:1736366276.735856:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d243440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013039232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366276.751407:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013039296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366276.751452:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366276.751510:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039296 00000100:00100000:0.0:1736366276.751561:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5903 00000100:00100000:0.0:1736366276.751566:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013039296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366276.751590:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366276.751644:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013039296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366276.751665:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5903 00000100:00100000:3.0:1736366276.751685:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013039296:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366277.061409:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366278.063372:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366278.768272:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366278.768324:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366278.768369:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366278.768411:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019456 00000100:00100000:1.0:1736366278.768412:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019392 00000100:00100000:2.0:1736366278.768449:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019328 00000100:00100000:1.0:1736366278.768455:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 750 00000100:00100000:0.0:1736366278.768461:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 974 00000100:00100000:1.0:1736366278.768463:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041019456:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366278.768467:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041019392:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:0.0:1736366278.768485:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366278.768504:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 225 00000100:00100000:2.0:1736366278.768510:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041019328:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366278.768541:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041019456:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 79us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366278.768549:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 750 00000100:00100000:2.0:1736366278.768561:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041019328:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 51us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366278.768569:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 225 00000100:00100000:0.0:1736366278.775253:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041019392:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 6783us (6882us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366278.775262:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 974 00000100:00080000:0.0:1736366278.991322:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366278.991328:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366278.991332:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366278.991338:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8622 00000100:00080000:0.0:1736366278.991341:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366278.991346:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366278.991364:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f5f00 x1820703013039424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366278.991391:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366278.991394:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366278.991396:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366278.991398:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8622 00000100:00080000:0.0:1736366278.991400:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366278.991403:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366278.991416:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013039360:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366278.991425:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f1c80 x1820703013039552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366278.991428:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013039488:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366278.991447:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366278.991450:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366278.991451:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366278.991454:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8622 00000100:00080000:0.0:1736366278.991455:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366278.991459:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366278.991467:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f3440 x1820703013039680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366278.991479:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366278.991481:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366278.991485:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366278.991487:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013039424:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366278.991488:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366278.991489:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366278.991492:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8622 00000100:00080000:0.0:1736366278.991493:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366278.991496:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366278.991503:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f7200 x1820703013039872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366278.991511:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013039808:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366278.991521:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013039744:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366278.991528:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013039616:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366278.991529:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366278.991537:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366278.991565:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039808 00000100:00100000:1.0:1736366278.991569:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013039552:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366278.991585:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366278.991587:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039360 00000100:00100000:3.0:1736366278.991594:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7257 00000100:00100000:3.0:1736366278.991599:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013039808:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366278.991603:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039488 00000100:00100000:2.0:1736366278.991612:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1736366278.991617:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013039360:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366278.991629:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039424 00000100:00100000:0.0:1736366278.991631:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039616 00000100:00100000:1.0:1736366278.991653:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1736366278.991657:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013039808:12345-0@lo:400:kworker/u8:0.0 Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366278.991658:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074519300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013039488:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366278.991658:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013039360:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366278.991663:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:2.0:1736366278.991665:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1736366278.991666:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7257 00000100:00100000:0.0:1736366278.991668:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d2404c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013039424:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366278.991679:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366278.991693:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366278.991699:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074519300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013039488:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366278.991706:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1736366278.991708:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013039808:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366278.991711:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d2404c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013039424:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (182us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366278.991715:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039744 00000100:00100000:2.0:1736366278.991717:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013039360:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366278.991725:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:1.0:1736366278.991731:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366278.991731:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7258 00000100:00100000:3.0:1736366278.991734:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013039744:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366278.991742:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f3440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013039680:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366278.991743:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039552 00000100:00100000:0.0:1736366278.991760:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:3.0:1736366278.991762:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013039744:12345-0@lo:400:kworker/u8:0.0 Request processed in 26us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366278.991764:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d243440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013039552:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366278.991767:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7258 00010000:02000000:0.0:1736366278.991771:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366278.991778:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013039744:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366278.991780:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366278.991792:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013039488:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366278.991795:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d243440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013039552:12345-0@lo:38:kworker/u8:0.0 Request processed in 30us (65us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366278.991800:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013039872:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366278.991801:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:2.0:1736366278.991811:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039680 00000100:00100000:1.0:1736366278.991817:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366278.991828:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77086 00000100:00100000:2.0:1736366278.991832:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d242f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013039680:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366278.991844:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039872 00000100:00080000:1.0:1736366278.991847:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366278.991850:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366278.991854:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013039424:0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366278.991855:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366278.991856:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1736366278.991860:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013039616:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366278.991861:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366278.991863:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366278.991866:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013039552:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366278.991889:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d242f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013039680:12345-0@lo:38:kworker/u8:0.0 Request processed in 55us (108us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366278.991890:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366278.991892:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013039616:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (308us total) trans 0 rc 0/0 00000100:00080000:1.0:1736366278.991892:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366278.991894:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f3440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013039680:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366278.991896:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77086 00000100:00100000:0.0:1736366278.991898:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1736366278.991910:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1736366278.991913:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d241300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013039872:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366278.991919:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366278.991936:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d241300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013039872:12345-0@lo:38:kworker/u8:0.0 Request processed in 22us (119us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366278.991941:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00080000:1.0:1736366278.991977:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366278.991980:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366278.991983:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013039872:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366278.992003:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013039616:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366279.065390:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366280.067406:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366281.069402:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366281.743448:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9ca600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013039936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366281.743519:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366281.743589:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013039936 00000100:00100000:0.0:1736366281.743648:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5904 00000100:00100000:0.0:1736366281.743655:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013039936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366281.743688:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366281.743764:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013039936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366281.743773:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5904 00000100:00100000:3.0:1736366281.743814:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9ca600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013039936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366281.759413:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007451a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013040000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366281.759454:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366281.759513:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040000 00000100:00100000:2.0:1736366281.759575:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5905 00000100:00100000:2.0:1736366281.759581:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013040000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366281.759604:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366281.759653:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013040000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366281.759660:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5905 00000100:00100000:0.0:1736366281.759672:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007451a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013040000:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366282.071414:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366283.073427:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366283.775757:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366283.775802:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366283.775840:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366283.775932:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019520 00000100:00100000:0.0:1736366283.775935:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019584 00000100:00100000:1.0:1736366283.775935:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019648 00000100:00100000:0.0:1736366283.775960:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 753 00000100:00100000:0.0:1736366283.775964:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041019648:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366283.775969:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 978 00000100:00100000:2.0:1736366283.775969:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 227 00000100:00100000:2.0:1736366283.775973:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041019520:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366283.775974:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041019584:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366283.775989:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366283.776020:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041019648:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 56us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366283.776021:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041019520:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 48us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366283.776025:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 753 00000100:00100000:2.0:1736366283.776026:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 227 00000100:00100000:1.0:1736366283.776239:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041019584:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 260us (396us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366283.776253:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 978 00000100:00080000:0.0:1736366283.999329:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366283.999335:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366283.999338:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366283.999343:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8627 00000100:00080000:0.0:1736366283.999347:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366283.999352:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366283.999369:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f3440 x1820703013040128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366283.999400:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366283.999404:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366283.999414:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366283.999418:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8627 00000100:00080000:0.0:1736366283.999419:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366283.999423:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366283.999431:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013040064:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366283.999434:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f5f00 x1820703013040256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366283.999447:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f3440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013040128:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366283.999448:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366283.999451:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366283.999452:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366283.999455:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8627 00000100:00080000:0.0:1736366283.999456:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366283.999459:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366283.999466:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f4c00 x1820703013040384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366283.999482:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366283.999487:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366283.999490:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366283.999491:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366283.999493:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366283.999494:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8627 00000100:00080000:0.0:1736366283.999495:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366283.999498:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366283.999503:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013040320:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366283.999507:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372eda40 x1820703013040576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366283.999511:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013040512:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366283.999520:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013040256:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366283.999532:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013040192:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366283.999538:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366283.999558:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736366283.999560:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366283.999563:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013040448:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366283.999579:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040512 00000100:00100000:0.0:1736366283.999580:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366283.999580:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013040384:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366283.999603:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366283.999607:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366283.999611:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040448 00000100:00100000:0.0:1736366283.999618:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040128 00000100:00100000:1.0:1736366283.999620:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013040576:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366283.999629:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7259 00000100:00100000:3.0:1736366283.999633:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cb900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013040512:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366283.999637:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7260 00000100:00100000:1.0:1736366283.999638:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366283.999644:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9ca600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013040448:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366283.999646:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040256 00000100:00100000:0.0:1736366283.999657:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040192 00000100:00100000:1.0:1736366283.999671:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040576 00000100:00100000:0.0:1736366283.999673:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:0.0:1736366283.999677:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372e9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013040192:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366283.999688:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:3.0:1736366283.999691:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cb900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013040512:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366283.999695:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d242600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013040128:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366283.999695:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9ca600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013040448:12345-0@lo:400:kworker/u8:0.0 Request processed in 51us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366283.999698:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7259 00000100:00100000:2.0:1736366283.999702:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7260 00010000:02000000:1.0:1736366283.999706:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366283.999716:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372e9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013040192:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366283.999722:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1736366283.999730:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1736366283.999731:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040384 00000100:00100000:1.0:1736366283.999733:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d242600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013040128:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (240us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366283.999743:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:3.0:1736366283.999745:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d245f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013040256:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366283.999747:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1736366283.999750:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a11300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013040576:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366283.999751:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77087 00000100:00100000:2.0:1736366283.999755:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d247200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013040384:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366283.999756:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736366283.999760:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366283.999765:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736366283.999776:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366283.999779:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366283.999783:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f3440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013040128:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366283.999790:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d245f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013040256:12345-0@lo:38:kworker/u8:0.0 Request processed in 46us (230us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366283.999791:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a11300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013040576:12345-0@lo:38:kworker/u8:0.0 Request processed in 40us (155us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366283.999794:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d247200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013040384:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (187us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366283.999797:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00080000:1.0:1736366283.999800:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366283.999801:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77087 00000100:00100000:0.0:1736366283.999802:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00080000:1.0:1736366283.999803:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366283.999805:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013040256:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366283.999813:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366283.999815:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366283.999816:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040064 00000100:00100000:1.0:1736366283.999817:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013040384:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366283.999829:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366283.999833:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013040192:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366283.999834:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00080000:1.0:1736366283.999837:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366283.999837:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013040064:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366283.999839:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366283.999842:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013040576:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366283.999855:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040320 00000100:00100000:2.0:1736366283.999859:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013040064:12345-0@lo:400:kworker/u8:0.0 Request processed in 21us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366283.999896:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1736366283.999905:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:0.0:1736366283.999909:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013040320:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366283.999931:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013040448:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366283.999941:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013040512:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366283.999943:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013040320:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366283.999949:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1736366283.999949:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013040064:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366283.999981:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013040320:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366284.075405:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366285.077402:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366286.079400:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366286.751441:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007451bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013040640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366286.751509:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366286.751575:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040640 00000100:00100000:2.0:1736366286.751637:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5906 00000100:00100000:2.0:1736366286.751643:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ed0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013040640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366286.751677:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366286.751748:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ed0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013040640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366286.751756:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5906 00000100:00100000:0.0:1736366286.751759:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007451bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013040640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366286.767399:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ef6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013040704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366286.767441:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366286.767510:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040704 00000100:00100000:0.0:1736366286.767560:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5907 00000100:00100000:0.0:1736366286.767567:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013040704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366286.767606:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366286.767667:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013040704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366286.767678:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5907 00000100:00100000:2.0:1736366286.767692:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ef6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013040704:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366287.081413:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366288.083413:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366288.784041:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366288.784085:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366288.784125:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366288.784212:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019840 00000100:00100000:3.0:1736366288.784212:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019712 00000100:00100000:2.0:1736366288.784249:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019776 00000100:00100000:3.0:1736366288.784259:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 229 00000100:00100000:3.0:1736366288.784266:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1876:x1820703041019712:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366288.784273:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 756 00000100:00100000:1.0:1736366288.784279:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ef200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1877:x1820703041019840:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366288.784286:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 982 00000100:00100000:2.0:1736366288.784292:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ed580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041019776:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:2.0:1736366288.784308:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366288.784340:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1876:x1820703041019712:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 72us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366288.784341:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ef200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1877:x1820703041019840:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 59us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366288.784350:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 229 00000100:00100000:1.0:1736366288.784351:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 756 00000100:00100000:2.0:1736366288.784360:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ed580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041019776:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 67us (234us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366288.784367:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 982 00000100:00080000:0.0:1736366289.007294:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366289.007300:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366289.007303:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366289.007309:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8632 00000100:00080000:0.0:1736366289.007312:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366289.007318:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366289.007335:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372e97c0 x1820703013040832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366289.007358:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366289.007361:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736366289.007361:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ea140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013040768:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366289.007362:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366289.007365:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8632 00000100:00080000:0.0:1736366289.007367:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366289.007370:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366289.007377:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372ee880 x1820703013040960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366289.007402:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736366289.007402:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013040896:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366289.007405:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366289.007416:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366289.007421:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8632 00000100:00080000:0.0:1736366289.007422:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1736366289.007423:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366289.007426:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366289.007437:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372ecc00 x1820703013041088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366289.007449:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366289.007455:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366289.007458:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366289.007459:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366289.007460:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013041216:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366289.007462:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8632 00000100:00080000:0.0:1736366289.007464:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366289.007466:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366289.007473:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372eb900 x1820703013041280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366289.007490:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040896 00000100:00100000:1.0:1736366289.007494:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366289.007498:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013041024:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366289.007507:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ec740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013041152:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366289.007518:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:2.0:1736366289.007522:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b68980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013040896:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366289.007531:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013040832:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366289.007533:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366289.007556:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366289.007567:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b68980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013040896:12345-0@lo:400:kworker/u8:0.0 Request processed in 43us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366289.007569:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366289.007573:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:0.0:1736366289.007585:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041024 00000100:00100000:1.0:1736366289.007586:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ee880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013040960:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366289.007599:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040768 00000100:00100000:2.0:1736366289.007601:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040832 00000100:00100000:1.0:1736366289.007608:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366289.007612:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1736366289.007614:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013040960 00000100:00100000:0.0:1736366289.007616:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ebdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013041024:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366289.007619:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ecc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013041088:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366289.007623:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:3.0:1736366289.007626:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1736366289.007627:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a12140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013040832:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366289.007631:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013040768:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:2.0:1736366289.007637:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366289.007643:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366289.007664:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ebdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013041024:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366289.007671:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1736366289.007672:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a12140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013040832:12345-0@lo:38:kworker/u8:0.0 Request processed in 45us (106us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366289.007679:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:1.0:1736366289.007682:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013041280:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366289.007687:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:3.0:1736366289.007690:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013040768:12345-0@lo:400:kworker/u8:0.0 Request processed in 58us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366289.007691:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a150c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013040960:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366289.007696:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366289.007697:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1736366289.007709:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366289.007713:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a150c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013040960:12345-0@lo:38:kworker/u8:0.0 Request processed in 22us (106us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366289.007718:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1736366289.007720:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013041024:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366289.007726:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041280 00000100:00100000:3.0:1736366289.007730:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041216 00000100:00100000:2.0:1736366289.007737:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00080000:1.0:1736366289.007740:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366289.007740:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a104c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013041280:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366289.007745:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366289.007748:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041152 00000100:00080000:1.0:1736366289.007753:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366289.007758:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013040832:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366289.007763:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a104c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013041280:12345-0@lo:38:kworker/u8:0.0 Request processed in 21us (55us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366289.007763:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7261 00000100:00100000:2.0:1736366289.007768:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:0.0:1736366289.007769:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041088 00000100:00080000:1.0:1736366289.007773:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366289.007811:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366289.007817:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77088 00000100:00100000:1.0:1736366289.007817:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ee880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013040960:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366289.007819:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013041216:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366289.007830:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a163c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013041088:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366289.007831:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366289.007833:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013040896:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366289.007835:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366289.007839:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013041280:0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366289.007841:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366289.007861:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013041216:12345-0@lo:400:kworker/u8:0.0 Request processed in 85us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366289.007867:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7261 00000100:00100000:2.0:1736366289.007872:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7262 00000100:00100000:2.0:1736366289.007876:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013041152:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366289.007881:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a163c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013041088:12345-0@lo:38:kworker/u8:0.0 Request processed in 52us (239us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366289.007888:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77088 00000100:00100000:1.0:1736366289.007905:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013041216:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366289.007915:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013041152:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366289.007918:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ea140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013040768:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366289.007920:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7262 00000100:00100000:3.0:1736366289.007929:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ec740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013041152:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366289.007951:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366289.007955:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366289.007959:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ecc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013041088:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366289.085401:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366290.087417:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366291.089422:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366291.759494:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736366291.759515:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007451d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013041344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366291.759576:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366291.759667:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041344 00000100:00100000:0.0:1736366291.759729:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5908 00000100:00100000:0.0:1736366291.759776:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a17200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013041344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366291.759811:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366291.759883:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a17200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013041344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366291.759895:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5908 00000100:00100000:1.0:1736366291.759929:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007451d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013041344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366291.775451:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013041408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366291.775495:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366291.775547:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041408 00000100:00100000:0.0:1736366291.775577:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5909 00000100:00100000:0.0:1736366291.775582:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b684c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013041408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366291.775603:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366291.775644:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b684c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013041408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366291.775650:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5909 00000100:00100000:2.0:1736366291.775659:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013041408:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366292.091420:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366293.093418:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366293.792090:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366293.792130:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366293.792194:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366293.792221:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019904 00000100:00100000:0.0:1736366293.792230:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020032 00000100:00100000:2.0:1736366293.792249:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041019968 00000100:00100000:3.0:1736366293.792279:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 231 00000100:00100000:0.0:1736366293.792284:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 759 00000100:00100000:3.0:1736366293.792285:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041019904:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366293.792290:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ea600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041020032:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366293.792298:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 986 00000100:00100000:2.0:1736366293.792304:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372edf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041019968:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:2.0:1736366293.792319:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366293.792340:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ea600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041020032:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 50us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366293.792340:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041019904:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 55us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366293.792347:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 231 00000100:00100000:0.0:1736366293.792357:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 759 00000100:00100000:2.0:1736366293.792357:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372edf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041019968:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 52us (163us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366293.792364:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 986 00000100:00080000:0.0:1736366294.015338:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366294.015345:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366294.015348:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366294.015353:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8637 00000100:00080000:0.0:1736366294.015357:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366294.015362:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366294.015378:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372eaac0 x1820703013041536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366294.015411:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366294.015415:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366294.015416:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366294.015419:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8637 00000100:00080000:0.0:1736366294.015421:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366294.015424:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366294.015433:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372ec740 x1820703013041664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366294.015435:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013041472:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366294.015440:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013041536:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366294.015447:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366294.015449:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366294.015450:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366294.015453:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8637 00000100:00080000:0.0:1736366294.015455:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366294.015458:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366294.015466:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372e9c80 x1820703013041792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366294.015483:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366294.015486:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366294.015495:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366294.015498:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366294.015499:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366294.015502:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8637 00000100:00080000:0.0:1736366294.015504:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366294.015506:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366294.015511:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ee880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013041920:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366294.015513:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ec740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013041664:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366294.015514:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372e97c0 x1820703013041984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366294.015520:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ea140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013041728:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366294.015536:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366294.015538:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366294.015539:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ecc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013041600:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366294.015554:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736366294.015559:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013041856:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366294.015565:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366294.015566:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013041792:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366294.015577:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366294.015585:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041920 00000100:00100000:1.0:1736366294.015594:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366294.015611:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041856 00000100:00100000:1.0:1736366294.015612:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013041984:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366294.015614:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041536 00000100:00100000:3.0:1736366294.015620:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041472 00000100:00100000:0.0:1736366294.015626:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7263 00000100:00100000:1.0:1736366294.015629:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366294.015631:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013041920:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366294.015645:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041664 00000100:00100000:3.0:1736366294.015647:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1736366294.015651:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013041472:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366294.015658:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041728 00000100:00100000:0.0:1736366294.015670:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013041920:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366294.015672:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041984 00000100:00100000:2.0:1736366294.015673:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1736366294.015676:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7263 00000100:00100000:2.0:1736366294.015677:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013041728:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366294.015683:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013041472:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366294.015690:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:0.0:1736366294.015691:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7264 00000100:00100000:0.0:1736366294.015729:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013041856:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366294.015738:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a15f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013041536:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366294.015743:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00010000:02000000:1.0:1736366294.015750:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366294.015758:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013041856:12345-0@lo:400:kworker/u8:0.0 Request processed in 63us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366294.015764:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7264 00000100:00100000:2.0:1736366294.015765:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013041728:12345-0@lo:400:kworker/u8:0.0 Request processed in 86us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366294.015772:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1736366294.015784:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a15f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013041536:12345-0@lo:38:kworker/u8:0.0 Request processed in 88us (299us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366294.015787:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1736366294.015788:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041792 00000100:00100000:0.0:1736366294.015792:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a12600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013041664:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366294.015792:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:2.0:1736366294.015796:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013041984:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366294.015802:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366294.015803:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00010000:02000000:2.0:1736366294.015806:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366294.015807:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77089 00000100:00100000:3.0:1736366294.015811:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a13440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013041792:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366294.015821:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366294.015831:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013041984:12345-0@lo:38:kworker/u8:0.0 Request processed in 34us (203us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366294.015843:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a12600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013041664:12345-0@lo:38:kworker/u8:0.0 Request processed in 51us (308us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366294.015848:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00080000:1.0:1736366294.015849:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366294.015852:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00080000:1.0:1736366294.015852:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366294.015852:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a13440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013041792:12345-0@lo:38:kworker/u8:0.0 Request processed in 40us (258us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366294.015856:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013041984:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366294.015858:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77089 00000100:00080000:1.0:1736366294.015865:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366294.015867:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366294.015870:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ec740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013041664:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366294.015876:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736366294.015878:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366294.015880:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366294.015882:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013041792:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366294.015889:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366294.015889:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ea140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013041728:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366294.015890:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013041856:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366294.015891:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366294.015893:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013041536:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366294.015900:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ee880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013041920:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366294.015903:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013041600 00000100:00100000:3.0:1736366294.015908:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013041472:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366294.015921:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1736366294.015924:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372eed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013041600:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366294.015950:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372eed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013041600:12345-0@lo:400:kworker/u8:0.0 Request processed in 25us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366294.015956:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:2.0:1736366294.015966:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ecc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013041600:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366294.095419:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366295.097418:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366296.099433:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366296.767522:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007451a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013042048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366296.767571:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366296.767632:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042048 00000100:00100000:0.0:1736366296.767714:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5910 00000100:00100000:0.0:1736366296.767720:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013042048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366296.767745:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366296.767788:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013042048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366296.767795:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5910 00000100:00100000:2.0:1736366296.767811:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007451a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013042048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366296.783442:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ef6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013042112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366296.783481:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366296.783534:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042112 00000100:00100000:0.0:1736366296.783563:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5911 00000100:00100000:0.0:1736366296.783569:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013042112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366296.783590:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366296.783629:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013042112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366296.783636:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5911 00000100:00100000:2.0:1736366296.783647:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ef6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013042112:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366297.101412:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366298.103418:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366298.800303:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366298.800353:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366298.800394:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366298.800453:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020224 00000100:00100000:2.0:1736366298.800454:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020160 00000100:00100000:3.0:1736366298.800481:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020096 00000100:00100000:2.0:1736366298.800496:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 762 00000100:00100000:2.0:1736366298.800504:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041020224:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366298.800511:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 990 00000100:00100000:0.0:1736366298.800517:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041020160:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366298.800522:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 233 00000100:00100000:3.0:1736366298.800528:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041020096:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:0.0:1736366298.800534:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366298.800585:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041020224:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 83us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366298.800587:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041020096:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 58us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366298.800590:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041020160:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 73us (196us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366298.800594:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 762 00000100:00100000:3.0:1736366298.800595:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 233 00000100:00100000:0.0:1736366298.800598:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 990 00000100:00080000:0.0:1736366299.023328:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366299.023335:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366299.023339:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366299.023345:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8642 00000100:00080000:0.0:1736366299.023348:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366299.023354:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366299.023372:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372eaf80 x1820703013042240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366299.023400:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366299.023403:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366299.023405:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366299.023407:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8642 00000100:00080000:0.0:1736366299.023409:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366299.023412:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366299.023421:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372eb900 x1820703013042368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366299.023428:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ecc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013042176:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366299.023438:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ee880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013042304:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366299.023443:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366299.023446:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366299.023458:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366299.023461:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8642 00000100:00080000:0.0:1736366299.023463:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366299.023466:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366299.023477:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372e9c80 x1820703013042496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366299.023496:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366299.023499:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736366299.023499:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013042240:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366299.023500:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366299.023503:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8642 00000100:00100000:3.0:1736366299.023503:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366299.023504:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366299.023505:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366299.023508:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366299.023514:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372ea140 x1820703013042688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366299.023535:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736366299.023541:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013042624:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366299.023545:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366299.023552:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ec740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013042560:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366299.023556:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042176 00000100:00100000:3.0:1736366299.023568:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366299.023570:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013042368:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366299.023587:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042304 00000100:00100000:0.0:1736366299.023588:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1736366299.023594:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013042176:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366299.023601:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366299.023642:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013042496:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366299.023651:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042240 00000100:00100000:3.0:1736366299.023661:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013042432:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366299.023667:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366299.023678:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013042176:12345-0@lo:400:kworker/u8:0.0 Request processed in 83us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366299.023679:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042368 00000100:00100000:0.0:1736366299.023685:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1736366299.023688:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ea140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013042688:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366299.023690:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366299.023693:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:2.0:1736366299.023698:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013042304:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366299.023706:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366299.023723:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042624 00000100:00100000:3.0:1736366299.023726:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042432 00000100:00100000:1.0:1736366299.023734:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042688 00000100:00100000:2.0:1736366299.023743:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013042304:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366299.023745:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7265 00000100:00100000:3.0:1736366299.023748:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:0.0:1736366299.023749:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800745197c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013042624:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366299.023752:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1736366299.023753:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800745184c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013042432:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366299.023757:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1736366299.023761:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013042240:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366299.023767:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:2.0:1736366299.023770:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013042368:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366299.023775:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366299.023779:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800745197c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013042624:12345-0@lo:400:kworker/u8:0.0 Request processed in 30us (211us total) trans 0 rc 0/0 00010000:02000000:2.0:1736366299.023780:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366299.023785:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7265 00000100:00100000:3.0:1736366299.023794:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800745184c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013042432:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366299.023801:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:1.0:1736366299.023812:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013042240:12345-0@lo:38:kworker/u8:0.0 Request processed in 50us (268us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366299.023812:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013042368:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (211us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366299.023814:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:0.0:1736366299.023815:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042496 00000100:00100000:3.0:1736366299.023817:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f4c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013042688:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366299.023819:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:1.0:1736366299.023822:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00010000:02000000:3.0:1736366299.023827:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366299.023831:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77090 00000100:00100000:0.0:1736366299.023834:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013042496:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366299.023839:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:0.0:1736366299.023844:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366299.023849:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f4c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013042688:12345-0@lo:38:kworker/u8:0.0 Request processed in 30us (142us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366299.023854:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366299.023855:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00080000:1.0:1736366299.023857:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366299.023861:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013042240:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366299.023866:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042560 00000100:00100000:0.0:1736366299.023871:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013042496:12345-0@lo:38:kworker/u8:0.0 Request processed in 36us (204us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366299.023871:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366299.023873:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366299.023875:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013042368:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366299.023878:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77090 00000100:00080000:1.0:1736366299.023883:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366299.023883:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7266 00000100:00100000:3.0:1736366299.023884:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013042432:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366299.023885:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366299.023887:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013042496:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366299.023887:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013042560:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366299.023911:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013042624:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366299.023915:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013042560:12345-0@lo:400:kworker/u8:0.0 Request processed in 28us (77us total) trans 0 rc 0/0 00000100:00080000:1.0:1736366299.023921:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366299.023921:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7266 00000100:00100000:3.0:1736366299.023922:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ee880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013042304:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366299.023923:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366299.023926:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ea140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013042688:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366299.023944:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ec740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013042560:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366299.023966:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ecc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013042176:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366299.105393:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366300.107396:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366301.109409:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366301.775619:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736366301.775642:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007451a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013042752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366301.775712:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366301.775796:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042752 00000100:00100000:0.0:1736366301.775868:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5912 00000100:00100000:0.0:1736366301.775874:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013042752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366301.775906:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366301.775958:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013042752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366301.775976:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5912 00000100:00100000:2.0:1736366301.775995:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007451a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013042752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366301.791398:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0df200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013042816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366301.791454:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366301.791513:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042816 00000100:00100000:0.0:1736366301.791559:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5913 00000100:00100000:0.0:1736366301.791588:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013042816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366301.791619:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366301.791669:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013042816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366301.791676:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5913 00000100:00100000:3.0:1736366301.791727:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0df200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013042816:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366302.111458:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366303.113412:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366303.808192:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366303.808245:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366303.808289:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366303.808334:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020416 00000100:00100000:2.0:1736366303.808339:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020288 00000100:00100000:2.0:1736366303.808384:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 235 00000100:00100000:0.0:1736366303.808386:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020352 00000100:00100000:2.0:1736366303.808391:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041020288:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366303.808403:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 765 00000100:00100000:0.0:1736366303.808410:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 994 00000100:00100000:3.0:1736366303.808412:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ecc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041020416:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366303.808427:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ec740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041020352:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:0.0:1736366303.808444:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366303.808464:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041020288:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 73us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366303.808472:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 235 00000100:00100000:3.0:1736366303.808476:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ecc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041020416:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 66us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366303.808481:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ec740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041020352:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 54us (192us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366303.808485:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 765 00000100:00100000:0.0:1736366303.808489:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 994 00000100:00080000:0.0:1736366304.031328:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366304.031336:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366304.031339:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366304.031346:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8647 00000100:00080000:0.0:1736366304.031349:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366304.031355:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366304.031374:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372ee880 x1820703013042944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366304.031408:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366304.031411:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366304.031413:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366304.031415:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8647 00000100:00080000:0.0:1736366304.031417:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366304.031420:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366304.031421:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ea140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013042880:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366304.031428:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372e9c80 x1820703013043072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366304.031442:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366304.031444:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366304.031445:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366304.031448:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8647 00000100:00080000:0.0:1736366304.031460:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366304.031463:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366304.031468:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013043136:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366304.031476:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372eaf80 x1820703013043200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366304.031492:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366304.031498:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ee880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013042944:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366304.031501:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366304.031504:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366304.031505:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366304.031509:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8647 00000100:00080000:0.0:1736366304.031510:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366304.031512:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366304.031521:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131caa140 x1820703013043392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366304.031556:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131cad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013043328:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366304.031573:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366304.031576:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013043264:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366304.031583:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366304.031589:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042880 00000100:00100000:3.0:1736366304.031616:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736366304.031622:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013043008:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366304.031627:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366304.031630:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043328 00000100:00100000:1.0:1736366304.031635:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1736366304.031641:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013042880:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366304.031649:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366304.031658:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043264 00000100:00100000:0.0:1736366304.031669:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7267 00000100:00100000:2.0:1736366304.031675:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7268 00000100:00100000:0.0:1736366304.031676:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dcc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013043328:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366304.031680:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cabdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013043264:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366304.031690:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013042880:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366304.031692:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043136 00000100:00100000:1.0:1736366304.031697:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1736366304.031713:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dcc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013043328:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366304.031718:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043008 00000100:00100000:0.0:1736366304.031719:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7267 00000100:00100000:2.0:1736366304.031721:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cabdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013043264:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366304.031727:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7268 00000100:00100000:3.0:1736366304.031732:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:3.0:1736366304.031737:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a03dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013043136:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366304.031744:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1736366304.031748:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013043008:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366304.031766:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131cad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013043328:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366304.031767:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013043264:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366304.031776:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ea140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013042880:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366304.031779:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013043008:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366304.031779:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a03dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013043136:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366304.031785:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:3.0:1736366304.031788:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1736366304.031805:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366304.031817:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013043008:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366304.031822:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013043072:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366304.031826:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013043136:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366304.031841:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366304.031864:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013042944 00000100:00100000:1.0:1736366304.031866:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013043200:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366304.031878:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043072 00000100:00100000:1.0:1736366304.031886:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366304.031900:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1736366304.031902:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013043392:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366304.031904:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013042944:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366304.031919:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:1.0:1736366304.031919:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1736366304.031919:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366304.031924:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013043072:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366304.031936:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366304.031940:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043392 00000100:00100000:1.0:1736366304.031943:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043200 00000100:00100000:3.0:1736366304.031951:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013042944:12345-0@lo:38:kworker/u8:0.0 Request processed in 45us (145us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366304.031957:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:0.0:1736366304.031967:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013043072:12345-0@lo:38:kworker/u8:0.0 Request processed in 43us (126us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366304.031971:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1736366304.031975:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77091 00000100:00100000:2.0:1736366304.031975:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d63440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013043392:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366304.031979:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f3440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013043200:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366304.031986:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366304.031987:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00010000:02000000:1.0:1736366304.031989:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366304.032018:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f3440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013043200:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (132us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366304.032024:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77091 00000100:00100000:2.0:1736366304.032031:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d63440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013043392:12345-0@lo:38:kworker/u8:0.0 Request processed in 56us (113us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366304.032038:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00080000:1.0:1736366304.032048:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366304.032051:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366304.032055:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013043392:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366304.032063:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366304.032065:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366304.032067:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ee880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013042944:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366304.032074:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366304.032076:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366304.032078:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013043072:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366304.032084:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366304.032086:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366304.032088:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013043200:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366304.115398:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366305.117358:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366306.119413:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366306.783523:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736366306.783545:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013043456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366306.783618:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366306.783682:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043456 00000100:00100000:0.0:1736366306.783730:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5914 00000100:00100000:0.0:1736366306.783736:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0daac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013043456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366306.783768:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366306.783834:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0daac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013043456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366306.783842:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5914 00000100:00100000:2.0:1736366306.783876:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013043456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366306.799411:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013043520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366306.799451:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366306.799480:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043520 00000100:00100000:0.0:1736366306.799539:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5915 00000100:00100000:0.0:1736366306.799544:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0db440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013043520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366306.799567:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366306.799622:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0db440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013043520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366306.799629:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5915 00000100:00100000:2.0:1736366306.799662:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013043520:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366307.121419:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366308.123409:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366308.815805:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366308.815856:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366308.815898:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366308.815934:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020608 00000100:00100000:3.0:1736366308.815955:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020544 00000100:00100000:0.0:1736366308.815976:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 768 00000100:00100000:0.0:1736366308.815983:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cae880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041020608:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366308.815987:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020480 00000100:00100000:3.0:1736366308.816015:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 998 00000100:00100000:3.0:1736366308.816021:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041020544:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:1.0:1736366308.816026:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 237 00000100:00100000:1.0:1736366308.816032:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041020480:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:3.0:1736366308.816038:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366308.816052:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cae880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041020608:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 69us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366308.816059:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 768 00000100:00100000:1.0:1736366308.816074:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041020480:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 43us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366308.816080:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041020544:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 58us (182us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366308.816087:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 998 00000100:00100000:1.0:1736366308.816098:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 237 00000100:00080000:0.0:1736366309.039331:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366309.039348:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366309.039351:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366309.039358:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8652 00000100:00080000:0.0:1736366309.039362:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366309.039367:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366309.039387:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131caf6c0 x1820703013043648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366309.039417:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366309.039421:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366309.039422:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366309.039425:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8652 00000100:00080000:0.0:1736366309.039427:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366309.039430:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366309.039433:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013043584:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366309.039437:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131ca8e40 x1820703013043776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366309.039468:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131cac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013043712:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366309.039482:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366309.039485:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366309.039486:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366309.039489:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8652 00000100:00080000:0.0:1736366309.039491:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366309.039494:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366309.039503:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131ca84c0 x1820703013043904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366309.039521:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366309.039524:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366309.039531:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366309.039534:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8652 00000100:00080000:0.0:1736366309.039536:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366309.039539:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366309.039541:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366309.039543:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366309.039549:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131ca97c0 x1820703013044096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366309.039550:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013043648:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366309.039578:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013043840:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366309.039589:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013044032:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366309.039596:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366309.039613:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043712 00000100:00100000:1.0:1736366309.039623:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013043776:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366309.039625:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366309.039625:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366309.039646:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043648 00000100:00100000:1.0:1736366309.039648:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366309.039650:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736366309.039656:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131cab900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013043968:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366309.039659:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013043904:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366309.039660:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043840 00000100:00100000:2.0:1736366309.039663:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044032 00000100:00100000:3.0:1736366309.039669:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043776 00000100:00100000:3.0:1736366309.039678:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1736366309.039679:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366309.039681:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366309.039684:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013043712:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366309.039698:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013044096:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366309.039701:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043968 00000100:00100000:1.0:1736366309.039714:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366309.039716:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7269 00000100:00100000:2.0:1736366309.039721:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013044032:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366309.039723:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7270 00000100:00100000:0.0:1736366309.039728:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cacc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013043968:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366309.039730:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013043712:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366309.039737:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:1.0:1736366309.039741:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043904 00000100:00100000:3.0:1736366309.039750:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044096 00000100:00100000:3.0:1736366309.039757:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1736366309.039759:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013044032:12345-0@lo:400:kworker/u8:0.0 Request processed in 37us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366309.039761:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cae3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013043840:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366309.039763:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77092 00000100:00100000:0.0:1736366309.039765:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cacc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013043968:12345-0@lo:400:kworker/u8:0.0 Request processed in 37us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366309.039766:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7269 00000100:00100000:1.0:1736366309.039768:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d60e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013043904:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366309.039772:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7270 00000100:00100000:3.0:1736366309.039781:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cae3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013043840:12345-0@lo:400:kworker/u8:0.0 Request processed in 20us (161us total) trans 0 rc 0/0 00010000:02000000:1.0:1736366309.039782:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366309.039786:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1736366309.039795:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:2.0:1736366309.039806:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013044032:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366309.039809:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1736366309.039809:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d64c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013043648:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366309.039811:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d60e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013043904:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (129us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366309.039813:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d64280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013043776:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366309.039817:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77092 00010000:02000000:3.0:1736366309.039820:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736366309.039824:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366309.039839:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013043584 00000100:00100000:2.0:1736366309.039840:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1736366309.039850:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d64c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013043648:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (254us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366309.039851:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d64280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013043776:12345-0@lo:38:kworker/u8:0.0 Request processed in 37us (203us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366309.039855:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d66880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013044096:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366309.039856:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1736366309.039857:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1736366309.039860:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1736366309.039861:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013043584:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:2.0:1736366309.039866:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366309.039889:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131cac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013043712:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366309.039893:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131cab900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013043968:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366309.039903:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013043840:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366309.039910:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013043584:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366309.039917:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1736366309.039917:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d66880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013044096:12345-0@lo:38:kworker/u8:0.0 Request processed in 62us (201us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366309.039923:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00080000:1.0:1736366309.039949:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366309.039950:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013043584:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366309.039952:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366309.039964:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131ca97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013044096:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366309.039977:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366309.039979:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366309.039981:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013043648:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366309.039989:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366309.039990:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366309.039992:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131ca8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013043776:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366309.040000:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366309.040001:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366309.040003:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131ca84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013043904:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366309.125368:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366310.127409:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366311.129460:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366311.791547:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736366311.791572:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013044160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366311.791641:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366311.791704:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044160 00000100:00100000:0.0:1736366311.791780:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5916 00000100:00100000:0.0:1736366311.791786:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0daf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013044160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366311.791819:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366311.791881:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0daf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013044160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366311.791889:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5916 00000100:00100000:2.0:1736366311.791916:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013044160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366311.807430:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0da140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013044224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366311.807473:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366311.807536:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044224 00000100:00100000:2.0:1736366311.807576:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5917 00000100:00100000:2.0:1736366311.807581:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013044224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366311.807604:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366311.807660:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013044224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366311.807667:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5917 00000100:00100000:0.0:1736366311.807795:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0da140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013044224:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366312.131469:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366313.133427:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366313.824278:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366313.824328:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366313.824389:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366313.824424:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020800 00000100:00100000:0.0:1736366313.824431:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020736 00000100:00100000:2.0:1736366313.824454:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020672 00000100:00100000:0.0:1736366313.824476:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 771 00000100:00100000:0.0:1736366313.824484:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041020800:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366313.824486:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1002 00000100:00100000:3.0:1736366313.824492:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041020736:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:2.0:1736366313.824496:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 239 00000100:00100000:2.0:1736366313.824502:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041020672:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:3.0:1736366313.824509:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366313.824555:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041020800:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 73us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366313.824564:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 771 00000100:00100000:2.0:1736366313.824564:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041020672:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 61us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366313.824569:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041020736:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 76us (202us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366313.824571:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 239 00000100:00100000:3.0:1736366313.824576:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1002 00000100:00080000:0.0:1736366314.047322:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366314.047328:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366314.047332:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366314.047338:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8657 00000100:00080000:0.0:1736366314.047342:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366314.047348:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366314.047399:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131cac740 x1820703013044352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366314.047435:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013044288:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366314.047451:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366314.047455:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366314.047456:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366314.047460:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8657 00000100:00080000:0.0:1736366314.047462:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00100000:2.0:1736366314.047465:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013044416:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366314.047466:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366314.047476:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131ca8000 x1820703013044480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366314.047490:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366314.047492:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366314.047494:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366314.047496:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8657 00000100:00100000:1.0:1736366314.047496:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131cac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013044352:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366314.047498:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366314.047501:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366314.047504:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366314.047510:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131cadf00 x1820703013044608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366314.047523:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366314.047533:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366314.047535:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366314.047536:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736366314.047537:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013044736:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366314.047539:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8657 00000100:00080000:0.0:1736366314.047541:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366314.047543:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366314.047550:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131ca8e40 x1820703013044800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366314.047563:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736366314.047569:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131cad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013044544:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366314.047577:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366314.047580:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366314.047591:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366314.047596:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044288 00000100:00100000:3.0:1736366314.047597:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013044672:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366314.047600:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044736 00000100:00100000:3.0:1736366314.047619:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366314.047620:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013044480:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366314.047630:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044672 00000100:00100000:0.0:1736366314.047633:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1736366314.047638:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013044288:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366314.047644:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7271 00000100:00100000:2.0:1736366314.047649:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a17297c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013044736:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366314.047649:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044416 00000100:00100000:1.0:1736366314.047653:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366314.047677:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044352 00000100:00100000:1.0:1736366314.047680:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131cadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013044608:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366314.047689:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044480 00000100:00100000:0.0:1736366314.047694:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013044288:12345-0@lo:400:kworker/u8:0.0 Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366314.047694:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a17297c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013044736:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366314.047700:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:0.0:1736366314.047701:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1736366314.047701:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7271 00000100:00100000:1.0:1736366314.047707:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366314.047714:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7272 00000100:00100000:3.0:1736366314.047715:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0da140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013044416:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366314.047717:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013044672:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366314.047723:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013044800:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366314.047737:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013044672:12345-0@lo:400:kworker/u8:0.0 Request processed in 19us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366314.047738:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:0.0:1736366314.047742:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d65f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013044352:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366314.047743:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7272 00000100:00100000:1.0:1736366314.047753:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:0.0:1736366314.047755:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366314.047759:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0da140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013044416:12345-0@lo:400:kworker/u8:0.0 Request processed in 44us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366314.047765:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:3.0:1736366314.047780:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044800 00000100:00100000:0.0:1736366314.047782:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d65f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013044352:12345-0@lo:38:kworker/u8:0.0 Request processed in 40us (207us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366314.047789:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:0.0:1736366314.047794:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:2.0:1736366314.047794:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013044480:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366314.047798:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:1.0:1736366314.047803:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d62600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013044800:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366314.047804:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736366314.047815:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366314.047826:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013044480:12345-0@lo:38:kworker/u8:0.0 Request processed in 34us (175us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366314.047831:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013044672:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366314.047832:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044608 00000100:00100000:2.0:1736366314.047833:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:1.0:1736366314.047840:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d62600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013044800:12345-0@lo:38:kworker/u8:0.0 Request processed in 36us (87us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366314.047842:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131ca84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013044736:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366314.047846:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77093 00000100:00100000:0.0:1736366314.047849:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013044288:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366314.047851:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d61300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013044608:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366314.047856:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1736366314.047858:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1736366314.047861:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1736366314.047880:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366314.047880:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131ca9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013044416:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366314.047882:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044544 00000100:00080000:0.0:1736366314.047883:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366314.047886:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131ca8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013044800:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366314.047886:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d61300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013044608:12345-0@lo:38:kworker/u8:0.0 Request processed in 35us (180us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366314.047892:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77093 00000100:00080000:0.0:1736366314.047894:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366314.047896:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366314.047898:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131cac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013044352:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366314.047905:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00080000:0.0:1736366314.047906:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366314.047908:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366314.047909:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0df200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013044544:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366314.047910:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013044480:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366314.047942:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366314.047944:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366314.047947:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131cadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013044608:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366314.047974:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0df200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013044544:12345-0@lo:400:kworker/u8:0.0 Request processed in 64us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366314.047981:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1736366314.048020:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131cad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013044544:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366314.135464:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366315.137393:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366316.139430:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366316.799518:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013044864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366316.799594:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366316.799657:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044864 00000100:00100000:0.0:1736366316.799721:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5918 00000100:00100000:0.0:1736366316.799727:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013044864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366316.799761:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366316.799824:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013044864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366316.799833:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5918 00000100:00100000:2.0:1736366316.799861:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013044864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366316.815409:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736366316.815426:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131cadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013044928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366316.815464:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366316.815529:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044928 00000100:00100000:0.0:1736366316.815568:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5919 00000100:00100000:0.0:1736366316.815574:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013044928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366316.815596:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366316.815637:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013044928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366316.815644:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5919 00000100:00100000:2.0:1736366316.815657:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131cadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013044928:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366317.141398:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366318.143409:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366318.832365:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366318.832415:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366318.832461:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366318.832528:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020864 00000100:00100000:3.0:1736366318.832569:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020992 00000100:00100000:1.0:1736366318.832584:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041020928 00000100:00100000:2.0:1736366318.832596:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 241 00000100:00100000:2.0:1736366318.832603:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041020864:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366318.832614:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 774 00000100:00100000:3.0:1736366318.832620:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041020992:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366318.832631:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1006 00000100:00100000:1.0:1736366318.832637:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cac740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041020928:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366318.832654:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366318.832677:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041020864:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 74us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366318.832685:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 241 00000100:00100000:3.0:1736366318.832686:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041020992:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 65us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366318.832691:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cac740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041020928:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 54us (231us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366318.832693:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 774 00000100:00100000:1.0:1736366318.832699:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1006 00000100:00080000:0.0:1736366319.055362:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366319.055369:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366319.055373:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366319.055380:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8662 00000100:00080000:0.0:1736366319.055384:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366319.055403:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366319.055409:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366319.055424:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131caaac0 x1820703013045056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366319.055433:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013044992:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366319.055447:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366319.055450:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366319.055451:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366319.055454:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8662 00000100:00080000:0.0:1736366319.055456:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366319.055459:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366319.055461:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736366319.055466:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131caed40 x1820703013045184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366319.055478:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013045120:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366319.055496:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366319.055499:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366319.055500:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366319.055504:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8662 00000100:00100000:2.0:1736366319.055504:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366319.055506:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366319.055508:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366319.055517:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131ca97c0 x1820703013045312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366319.055531:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366319.055547:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366319.055550:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366319.055551:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366319.055554:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8662 00000100:00100000:2.0:1736366319.055555:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013044992 00000100:00080000:0.0:1736366319.055556:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:1.0:1736366319.055557:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131cac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013045440:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366319.055559:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366319.055564:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013045248:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366319.055577:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131caf200 x1820703013045504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366319.055580:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366319.055603:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013045056:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366319.055604:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013045376:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366319.055606:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1736366319.055610:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366319.055615:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013044992:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366319.055622:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366319.055644:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366319.055664:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013045184:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366319.055665:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045120 00000100:00100000:3.0:1736366319.055668:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045248 00000100:00100000:2.0:1736366319.055679:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013044992:12345-0@lo:400:kworker/u8:0.0 Request processed in 66us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366319.055684:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366319.055687:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1736366319.055698:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045056 00000100:00100000:3.0:1736366319.055699:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045184 00000100:00100000:0.0:1736366319.055701:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013045312:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366319.055709:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:1.0:1736366319.055713:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869376c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013045120:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366319.055713:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:0.0:1736366319.055719:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366319.055723:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045440 00000100:00100000:3.0:1736366319.055728:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013045248:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366319.055730:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013045504:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366319.055743:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045376 00000100:00100000:0.0:1736366319.055746:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366319.055755:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869376c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013045120:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366319.055757:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7273 00000100:00100000:2.0:1736366319.055760:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086931300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013045440:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366319.055762:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:3.0:1736366319.055775:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013045248:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366319.055776:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045504 00000100:00100000:0.0:1736366319.055779:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:0.0:1736366319.055784:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013045056:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366319.055785:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:1.0:1736366319.055790:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1736366319.055790:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086931300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013045440:12345-0@lo:400:kworker/u8:0.0 Request processed in 28us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366319.055796:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7273 00010000:02000000:0.0:1736366319.055799:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366319.055804:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cad0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013045184:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366319.055806:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1736366319.055807:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7274 00000100:00100000:3.0:1736366319.055809:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cad580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013045504:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366319.055810:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086933440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013045376:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:1.0:1736366319.055815:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736366319.055819:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366319.055829:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013045056:12345-0@lo:38:kworker/u8:0.0 Request processed in 45us (186us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366319.055836:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:2.0:1736366319.055842:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086933440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013045376:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366319.055848:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7274 00000100:00100000:1.0:1736366319.055850:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cad0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013045184:12345-0@lo:38:kworker/u8:0.0 Request processed in 46us (166us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366319.055851:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cad580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013045504:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (104us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366319.055856:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1736366319.055860:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00080000:0.0:1736366319.055874:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366319.055876:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366319.055880:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013045056:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366319.055881:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013045376:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366319.055883:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045312 00000100:00080000:0.0:1736366319.055889:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366319.055891:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366319.055893:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013045184:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366319.055893:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013045248:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366319.055898:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77094 00000100:00080000:0.0:1736366319.055900:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736366319.055901:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cadf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013045312:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366319.055902:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00010000:02000000:1.0:1736366319.055908:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366319.055911:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131ca8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013044992:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366319.055912:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013045504:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366319.055926:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cadf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013045312:12345-0@lo:38:kworker/u8:0.0 Request processed in 23us (206us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366319.055931:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77094 00000100:00080000:0.0:1736366319.055935:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366319.055937:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366319.055940:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131ca97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013045312:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366319.055958:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131cac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013045440:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366319.055967:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131ca84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013045120:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366319.145435:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366320.147406:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366321.149423:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366321.807674:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800869c3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013045568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366321.807745:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366321.807809:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045568 00000100:00100000:0.0:1736366321.807857:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5920 00000100:00100000:0.0:1736366321.807863:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013045568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366321.807895:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366321.807960:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013045568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366321.807968:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5920 00000100:00100000:2.0:1736366321.807995:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800869c3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013045568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366321.823425:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013045632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366321.823470:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366321.823531:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045632 00000100:00100000:0.0:1736366321.823576:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5921 00000100:00100000:0.0:1736366321.823582:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c3440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013045632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366321.823604:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366321.823655:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c3440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013045632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366321.823662:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5921 00000100:00100000:3.0:1736366321.823699:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013045632:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366322.151432:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366323.153447:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366323.840314:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366323.840365:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366323.840406:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366323.840465:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021056 00000100:00100000:1.0:1736366323.840499:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021120 00000100:00100000:2.0:1736366323.840520:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 243 00000100:00100000:3.0:1736366323.840529:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021184 00000100:00100000:1.0:1736366323.840539:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1010 00000100:00100000:2.0:1736366323.840540:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041021056:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366323.840544:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041021120:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366323.840562:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366323.840586:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 777 00000100:00100000:3.0:1736366323.840595:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caf200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041021184:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366323.840626:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041021056:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 87us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366323.840627:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041021120:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 81us (262us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366323.840636:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1010 00000100:00100000:2.0:1736366323.840636:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 243 00000100:00100000:3.0:1736366323.840654:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caf200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041021184:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 58us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366323.840664:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 777 00000100:00080000:0.0:1736366324.063335:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366324.063341:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366324.063345:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366324.063351:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8667 00000100:00080000:0.0:1736366324.063369:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366324.063376:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366324.063396:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131caaac0 x1820703013045760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366324.063429:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013045696:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366324.063434:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366324.063437:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366324.063438:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366324.063441:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8667 00000100:00080000:0.0:1736366324.063443:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366324.063446:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366324.063452:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366324.063455:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131ca84c0 x1820703013045888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366324.063469:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736366324.063471:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013045824:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366324.063472:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366324.063473:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366324.063475:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8667 00000100:00080000:0.0:1736366324.063477:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366324.063480:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366324.063488:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131ca8e40 x1820703013046016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366324.063502:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366324.063508:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366324.063510:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366324.063511:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366324.063514:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8667 00000100:00080000:0.0:1736366324.063516:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1736366324.063519:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013045760:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366324.063525:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366324.063537:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372eaf80 x1820703013046208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366324.063545:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366324.063546:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013046144:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366324.063563:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736366324.063567:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366324.063573:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131cac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013045952:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366324.063575:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366324.063589:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736366324.063592:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013045888:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366324.063595:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013046080:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366324.063595:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045824 00000100:00100000:0.0:1736366324.063610:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366324.063612:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366324.063632:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045760 00000100:00100000:1.0:1736366324.063639:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366324.063649:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045952 00000100:00100000:1.0:1736366324.063656:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013046016:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366324.063657:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045888 00000100:00100000:2.0:1736366324.063658:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046144 00000100:00100000:3.0:1736366324.063661:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1736366324.063667:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013045824:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366324.063675:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366324.063677:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1736366324.063683:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372e9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013045952:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366324.063684:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046080 00000100:00100000:1.0:1736366324.063691:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013046208:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366324.063697:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7275 00000100:00100000:2.0:1736366324.063702:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013046144:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366324.063709:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366324.063716:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013045824:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366324.063722:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372e9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013045952:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366324.063723:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1736366324.063728:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1736366324.063736:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046208 00000100:00100000:3.0:1736366324.063738:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:2.0:1736366324.063739:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013046144:12345-0@lo:400:kworker/u8:0.0 Request processed in 37us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366324.063741:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086935a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013045760:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366324.063743:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:2.0:1736366324.063746:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7275 00000100:00100000:0.0:1736366324.063747:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086936880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013045888:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366324.063755:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00010000:02000000:3.0:1736366324.063755:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736366324.063757:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366324.063760:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869304c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013046208:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366324.063760:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7276 00000100:00100000:2.0:1736366324.063763:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013046080:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:1.0:1736366324.063771:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366324.063789:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013046080:12345-0@lo:400:kworker/u8:0.0 Request processed in 25us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366324.063790:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086936880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013045888:12345-0@lo:38:kworker/u8:0.0 Request processed in 43us (151us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366324.063793:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086935a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013045760:12345-0@lo:38:kworker/u8:0.0 Request processed in 50us (226us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366324.063794:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7276 00000100:00100000:0.0:1736366324.063796:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1736366324.063800:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1736366324.063802:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869304c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013046208:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (92us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366324.063808:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:2.0:1736366324.063822:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013045696 00000100:00100000:1.0:1736366324.063829:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046016 00000100:00100000:3.0:1736366324.063835:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131ca9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013045824:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366324.063838:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131cac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013045952:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366324.063841:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1736366324.063844:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77095 00000100:00100000:1.0:1736366324.063848:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869363c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013046016:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366324.063853:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366324.063855:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013045696:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366324.063869:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869363c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013046016:12345-0@lo:38:kworker/u8:0.0 Request processed in 21us (194us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366324.063875:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77095 00000100:00100000:2.0:1736366324.063884:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013045696:12345-0@lo:400:kworker/u8:0.0 Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366324.063889:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1736366324.063896:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366324.063899:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366324.063902:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013046208:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366324.063911:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366324.063913:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366324.063915:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013045760:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366324.063923:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013046080:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366324.063933:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366324.063933:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013046144:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366324.063935:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366324.063938:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131ca84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013045888:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366324.063940:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013045696:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366324.063946:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366324.063948:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366324.063951:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131ca8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013046016:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366324.155409:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366325.157410:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366326.159407:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366326.815502:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013046272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366326.815572:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366326.815649:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046272 00000100:00100000:2.0:1736366326.815703:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5922 00000100:00100000:2.0:1736366326.815709:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ee880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013046272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366326.815742:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366326.815794:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ee880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013046272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366326.815801:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5922 00000100:00100000:0.0:1736366326.815821:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013046272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366326.831409:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800869c2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013046336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366326.831448:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366326.831578:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046336 00000100:00100000:2.0:1736366326.831627:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5923 00000100:00100000:2.0:1736366326.831632:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372eb900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013046336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366326.831657:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366326.831701:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372eb900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013046336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366326.831708:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5923 00000100:00100000:0.0:1736366326.831724:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800869c2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013046336:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366327.161377:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366328.163422:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366328.848224:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366328.848274:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366328.848316:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366328.848358:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021248 00000100:00100000:3.0:1736366328.848414:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021376 00000100:00100000:2.0:1736366328.848423:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 245 00000100:00100000:2.0:1736366328.848443:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041021248:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366328.848445:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021312 00000100:00100000:3.0:1736366328.848474:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 780 00000100:00100000:3.0:1736366328.848482:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372e97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041021376:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366328.848483:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1014 00000100:00100000:1.0:1736366328.848489:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ea140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041021312:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366328.848506:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366328.848517:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041021248:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 75us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366328.848525:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 245 00000100:00100000:3.0:1736366328.848531:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372e97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041021376:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 51us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366328.848539:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 780 00000100:00100000:1.0:1736366328.848554:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ea140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041021312:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 65us (238us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366328.848562:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1014 00000100:00080000:0.0:1736366329.071329:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366329.071336:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366329.071339:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366329.071346:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8672 00000100:00080000:0.0:1736366329.071350:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366329.071355:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366329.071376:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801372eaf80 x1820703013046464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366329.071406:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366329.071409:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366329.071410:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366329.071413:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8672 00000100:00080000:0.0:1736366329.071415:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366329.071417:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366329.071425:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f79c80 x1820703013046592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366329.071436:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013046528:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366329.071436:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013046400:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366329.071447:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366329.071450:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366329.071451:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366329.071454:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8672 00000100:00080000:0.0:1736366329.071455:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366329.071458:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366329.071480:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f7cc00 x1820703013046720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366329.071499:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366329.071502:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736366329.071502:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013046464:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366329.071504:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366329.071506:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8672 00000100:00080000:0.0:1736366329.071508:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366329.071511:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366329.071517:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366329.071519:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f7df00 x1820703013046912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366329.071520:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366329.071545:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f79300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013046784:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366329.071554:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736366329.071560:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013046848:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366329.071562:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366329.071577:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046400 00000100:00100000:2.0:1736366329.071586:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366329.071589:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f79c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013046592:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366329.071611:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1736366329.071613:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046528 00000100:00100000:3.0:1736366329.071617:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013046400:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366329.071621:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366329.071631:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046848 00000100:00100000:1.0:1736366329.071633:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013046720:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366329.071642:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046464 00000100:00100000:0.0:1736366329.071655:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046592 00000100:00100000:1.0:1736366329.071655:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366329.071657:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7277 00000100:00100000:3.0:1736366329.071661:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013046400:12345-0@lo:400:kworker/u8:0.0 Request processed in 44us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366329.071662:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013046848:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366329.071668:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:3.0:1736366329.071668:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1736366329.071672:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013046912:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366329.071673:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013046528:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366329.071693:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366329.071700:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046912 00000100:00100000:2.0:1736366329.071706:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013046848:12345-0@lo:400:kworker/u8:0.0 Request processed in 44us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366329.071712:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7277 00000100:00100000:3.0:1736366329.071712:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:0.0:1736366329.071717:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013046528:12345-0@lo:400:kworker/u8:0.0 Request processed in 43us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366329.071717:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086932ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013046464:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366329.071723:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1736366329.071726:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046720 00010000:02000000:3.0:1736366329.071729:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366329.071736:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013046656:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366329.071743:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1736366329.071747:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086932140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013046592:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366329.071748:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77096 00010000:02000000:0.0:1736366329.071756:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366329.071760:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086932ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013046464:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (198us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366329.071761:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366329.071763:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869350c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013046720:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366329.071766:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00010000:02000000:1.0:1736366329.071774:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366329.071779:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086932140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013046592:12345-0@lo:38:kworker/u8:0.0 Request processed in 31us (158us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366329.071781:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046656 00000100:00100000:0.0:1736366329.071784:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:3.0:1736366329.071793:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:2.0:1736366329.071795:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013046848:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366329.071798:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013046656:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366329.071799:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1736366329.071804:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869350c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013046720:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (148us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366329.071806:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013046528:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366329.071812:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013046912:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366329.071812:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77096 00010000:02000000:0.0:1736366329.071820:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366329.071824:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013046656:12345-0@lo:400:kworker/u8:0.0 Request processed in 27us (65us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366329.071830:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:2.0:1736366329.071831:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013046656:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366329.071841:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013046912:12345-0@lo:38:kworker/u8:0.0 Request processed in 31us (148us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366329.071847:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00080000:1.0:1736366329.071848:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366329.071851:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366329.071855:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013046912:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366329.071856:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013046400:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366329.071864:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366329.071866:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366329.071869:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013046464:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366329.071870:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736366329.071876:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366329.071878:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366329.071880:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f79c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013046592:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366329.071887:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366329.071889:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366329.071891:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013046720:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366329.071902:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046784 00000100:00100000:2.0:1736366329.071923:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7278 00000100:00100000:2.0:1736366329.071927:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013046784:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366329.071994:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013046784:12345-0@lo:400:kworker/u8:0.0 Request processed in 66us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366329.072001:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7278 00000100:00100000:0.0:1736366329.072038:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f79300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013046784:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366329.165415:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366330.167399:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366331.169405:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366331.823481:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013046976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366331.823553:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366331.823617:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013046976 00000100:00100000:2.0:1736366331.823661:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5924 00000100:00100000:2.0:1736366331.823667:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f79300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013046976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366331.823701:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366331.823763:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f79300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013046976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366331.823771:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5924 00000100:00100000:0.0:1736366331.823803:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013046976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366331.839410:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013047040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366331.839454:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366331.839516:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047040 00000100:00100000:0.0:1736366331.839549:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5925 00000100:00100000:0.0:1736366331.839554:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013047040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366331.839577:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366331.839628:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013047040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366331.839635:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5925 00000100:00100000:2.0:1736366331.839667:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013047040:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366332.171413:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366333.173418:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366333.856254:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366333.856299:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366333.856343:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366333.856398:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021440 00000100:00100000:2.0:1736366333.856415:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021568 00000100:00100000:1.0:1736366333.856436:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021504 00000100:00100000:3.0:1736366333.856460:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 247 00000100:00100000:2.0:1736366333.856470:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 783 00000100:00100000:3.0:1736366333.856471:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041021440:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366333.856476:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041021568:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366333.856485:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1018 00000100:00100000:1.0:1736366333.856490:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f78980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041021504:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366333.856507:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366333.856560:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041021568:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 81us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366333.856563:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f78980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041021504:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 72us (220us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366333.856563:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041021440:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 94us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366333.856572:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 783 00000100:00100000:3.0:1736366333.856573:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 247 00000100:00100000:1.0:1736366333.856586:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1018 00000100:00080000:0.0:1736366334.079326:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366334.079332:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366334.079336:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366334.079342:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8677 00000100:00080000:0.0:1736366334.079345:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366334.079363:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366334.079383:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f78e40 x1820703013047168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366334.079420:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366334.079423:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736366334.079423:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013047104:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366334.079424:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366334.079427:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8677 00000100:00080000:0.0:1736366334.079429:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366334.079432:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366334.079440:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f7af80 x1820703013047296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366334.079452:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366334.079455:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366334.079456:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366334.079459:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8677 00000100:00080000:0.0:1736366334.079461:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366334.079464:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366334.079473:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f7e3c0 x1820703013047424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366334.079473:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013047360:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366334.079476:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f784c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013047232:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366334.079493:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366334.079493:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366334.079496:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366334.079497:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366334.079500:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8677 00000100:00080000:0.0:1736366334.079501:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366334.079503:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366334.079522:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f7bdc0 x1820703013047616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366334.079542:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013047552:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366334.079543:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366334.079554:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f78e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013047168:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366334.079558:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047104 00000100:00100000:1.0:1736366334.079570:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366334.079585:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736366334.079590:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013047488:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366334.079593:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366334.079598:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047552 00000100:00100000:3.0:1736366334.079602:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1736366334.079610:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366334.079611:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013047296:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366334.079611:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013047104:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366334.079627:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047488 00000100:00100000:0.0:1736366334.079628:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366334.079638:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013047424:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366334.079649:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047360 00000100:00100000:0.0:1736366334.079659:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366334.079665:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7279 00000100:00100000:0.0:1736366334.079671:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013047616:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366334.079671:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869317c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013047552:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366334.079671:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013047104:12345-0@lo:400:kworker/u8:0.0 Request processed in 61us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366334.079678:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047168 00000100:00100000:3.0:1736366334.079681:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1736366334.079685:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366334.079703:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047296 00000100:00100000:1.0:1736366334.079711:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047616 00000100:00100000:2.0:1736366334.079715:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869317c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013047552:12345-0@lo:400:kworker/u8:0.0 Request processed in 43us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366334.079720:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:2.0:1736366334.079724:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7279 00000100:00100000:1.0:1736366334.079725:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013047360:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366334.079732:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7280 00000100:00100000:3.0:1736366334.079737:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:0.0:1736366334.079738:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086935580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013047488:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366334.079744:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013047168:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366334.079758:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00010000:02000000:3.0:1736366334.079761:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366334.079763:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013047296:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366334.079764:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013047360:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366334.079772:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00010000:02000000:2.0:1736366334.079772:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366334.079773:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086935580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013047488:12345-0@lo:400:kworker/u8:0.0 Request processed in 36us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366334.079780:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7280 00000100:00100000:1.0:1736366334.079785:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:1.0:1736366334.079789:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013047616:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366334.079798:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366334.079802:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013047168:12345-0@lo:38:kworker/u8:0.0 Request processed in 57us (208us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366334.079810:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013047296:12345-0@lo:38:kworker/u8:0.0 Request processed in 47us (181us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366334.079812:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:1.0:1736366334.079818:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013047616:12345-0@lo:38:kworker/u8:0.0 Request processed in 28us (132us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366334.079818:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1736366334.079820:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047424 00000100:00100000:1.0:1736366334.079824:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1736366334.079839:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77097 00000100:00100000:3.0:1736366334.079839:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366334.079843:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f797c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013047424:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366334.079852:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366334.079858:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013047360:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366334.079860:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013047488:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366334.079869:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013047552:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366334.079879:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f797c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013047424:12345-0@lo:38:kworker/u8:0.0 Request processed in 35us (220us total) trans 0 rc -19/-19 00000100:00080000:3.0:1736366334.079884:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366334.079885:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77097 00000100:00080000:3.0:1736366334.079888:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366334.079893:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f78e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013047168:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366334.079898:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013047104:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366334.079907:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366334.079910:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366334.079911:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047232 00000100:00100000:3.0:1736366334.079914:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013047296:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366334.079926:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366334.079938:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366334.079941:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:3.0:1736366334.079942:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013047424:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366334.079947:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013047232:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366334.079958:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366334.079961:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366334.079965:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013047616:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366334.080012:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013047232:12345-0@lo:400:kworker/u8:0.0 Request processed in 64us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366334.080022:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1736366334.080082:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f784c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013047232:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366334.175399:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366335.177399:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366336.179409:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366336.831544:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f784c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013047680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366336.831625:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366336.831701:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047680 00000100:00100000:0.0:1736366336.831756:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5926 00000100:00100000:0.0:1736366336.831777:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013047680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366336.831810:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366336.831872:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013047680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366336.831880:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5926 00000100:00100000:2.0:1736366336.831916:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f784c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013047680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366336.847361:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013047744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366336.847411:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366336.847449:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047744 00000100:00100000:0.0:1736366336.847495:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5927 00000100:00100000:0.0:1736366336.847500:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013047744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366336.847523:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366336.847574:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013047744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366336.847581:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5927 00000100:00100000:3.0:1736366336.847622:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013047744:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366337.181423:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366338.183435:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366338.864219:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366338.864268:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366338.864311:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366338.864353:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021760 00000100:00100000:3.0:1736366338.864360:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021632 00000100:00100000:0.0:1736366338.864392:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021696 00000100:00100000:1.0:1736366338.864405:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 786 00000100:00100000:1.0:1736366338.864415:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041021760:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366338.864420:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 249 00000100:00100000:0.0:1736366338.864422:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1022 00000100:00100000:0.0:1736366338.864427:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f784c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041021696:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366338.864429:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041021632:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:0.0:1736366338.864444:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366338.864499:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041021760:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366338.864502:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041021632:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 73us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366338.864503:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f784c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041021696:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 75us (192us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366338.864508:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 786 00000100:00100000:0.0:1736366338.864512:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1022 00000100:00100000:3.0:1736366338.864513:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 249 00000100:00080000:0.0:1736366339.087324:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366339.087331:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366339.087335:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366339.087353:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8682 00000100:00080000:0.0:1736366339.087357:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366339.087363:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366339.087383:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f7e3c0 x1820703013047872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366339.087412:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366339.087415:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366339.087417:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366339.087420:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8682 00000100:00080000:0.0:1736366339.087422:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00100000:2.0:1736366339.087423:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013047808:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366339.087424:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366339.087433:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f78e40 x1820703013048000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366339.087435:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013047936:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366339.087453:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366339.087456:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366339.087457:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366339.087460:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8682 00000100:00080000:0.0:1736366339.087461:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366339.087464:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366339.087467:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013047872:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366339.087473:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f7a140 x1820703013048128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366339.087491:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366339.087494:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366339.087496:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366339.087498:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8682 00000100:00080000:0.0:1736366339.087505:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366339.087509:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366339.087512:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366339.087512:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366339.087519:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f7c740 x1820703013048320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366339.087523:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013048192:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366339.087543:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013048064:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366339.087554:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736366339.087560:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013048256:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366339.087562:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366339.087580:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366339.087583:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047808 00000100:00100000:1.0:1736366339.087585:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366339.087600:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366339.087617:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f78e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013048000:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366339.087620:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048064 00000100:00100000:1.0:1736366339.087620:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047936 00000100:00100000:2.0:1736366339.087623:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1736366339.087631:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013047808:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366339.087646:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013047872 00000100:00100000:3.0:1736366339.087646:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366339.087664:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048000 00000100:00100000:1.0:1736366339.087667:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:1.0:1736366339.087672:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086937200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013047936:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366339.087675:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013048128:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366339.087676:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:2.0:1736366339.087677:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013047808:12345-0@lo:400:kworker/u8:0.0 Request processed in 47us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366339.087681:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013048064:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366339.087687:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1736366339.087712:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086937200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013047936:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366339.087718:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1736366339.087724:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013048064:12345-0@lo:400:kworker/u8:0.0 Request processed in 43us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366339.087725:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366339.087731:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:2.0:1736366339.087732:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048192 00000100:00100000:1.0:1736366339.087734:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1736366339.087738:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013047872:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366339.087745:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013048320:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366339.087748:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00010000:02000000:1.0:1736366339.087749:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366339.087752:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013048000:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366339.087759:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048256 00010000:02000000:0.0:1736366339.087761:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366339.087774:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366339.087778:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013047872:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (180us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366339.087779:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7281 00000100:00100000:0.0:1736366339.087786:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013048000:12345-0@lo:38:kworker/u8:0.0 Request processed in 32us (139us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366339.087786:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1736366339.087787:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013048192:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366339.087800:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366339.087802:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00080000:3.0:1736366339.087804:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366339.087807:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048320 00000100:00100000:3.0:1736366339.087810:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013047872:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366339.087823:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00080000:3.0:1736366339.087823:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736366339.087826:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372eaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013048320:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366339.087827:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366339.087829:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013048192:12345-0@lo:400:kworker/u8:0.0 Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366339.087830:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f78e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013048000:0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366339.087832:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366339.087839:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7281 00000100:00100000:0.0:1736366339.087849:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013048064:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366339.087854:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372eaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013048320:12345-0@lo:38:kworker/u8:0.0 Request processed in 27us (81us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366339.087854:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7282 00000100:00100000:1.0:1736366339.087859:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1736366339.087859:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086932600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013048256:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366339.087863:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366339.087867:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366339.087871:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013048320:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366339.087889:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013047936:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366339.087893:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086932600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013048256:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366339.087900:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048128 00000100:00100000:2.0:1736366339.087901:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7282 00000100:00100000:1.0:1736366339.087906:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013048256:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366339.087929:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77098 00000100:00100000:2.0:1736366339.087933:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013047808:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366339.087935:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372eaf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013048128:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366339.088026:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366339.088089:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372eaf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013048128:12345-0@lo:38:kworker/u8:0.0 Request processed in 151us (362us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366339.088097:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77098 00000100:00080000:0.0:1736366339.088125:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366339.088129:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366339.088129:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013048192:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366339.088132:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013048128:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366339.185389:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366340.187398:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366341.189402:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366341.839489:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736366341.839509:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013048384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366341.839580:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366341.839756:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048384 00000100:00100000:0.0:1736366341.839819:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5928 00000100:00100000:0.0:1736366341.839836:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013048384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366341.839870:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366341.839985:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013048384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 149us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366341.839994:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5928 00000100:00100000:3.0:1736366341.840035:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013048384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366341.855360:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736366341.855376:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013048448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366341.855414:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366341.855469:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048448 00000100:00100000:0.0:1736366341.855515:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5929 00000100:00100000:0.0:1736366341.855520:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137129300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013048448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366341.855543:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366341.855585:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137129300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013048448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366341.855592:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5929 00000100:00100000:2.0:1736366341.855605:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131ca84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013048448:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366342.191422:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366343.193420:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366343.872352:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366343.872400:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366343.872441:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366343.872483:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021952 00000100:00100000:2.0:1736366343.872500:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021824 00000100:00100000:0.0:1736366343.872521:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041021888 00000100:00100000:0.0:1736366343.872535:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 789 00000100:00100000:0.0:1736366343.872542:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041021952:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366343.872547:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1026 00000100:00100000:1.0:1736366343.872555:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041021888:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366343.872574:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366343.872578:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 251 00000100:00100000:2.0:1736366343.872587:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041021824:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366343.872610:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041021952:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 68us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366343.872618:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 789 00000100:00100000:1.0:1736366343.872629:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041021888:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 74us (188us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366343.872636:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1026 00000100:00100000:2.0:1736366343.872641:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041021824:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 53us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366343.872652:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 251 00000100:00080000:0.0:1736366344.095325:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366344.095332:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366344.095335:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366344.095341:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8687 00000100:00080000:0.0:1736366344.095355:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366344.095360:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366344.095381:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f7df00 x1820703013048576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366344.095409:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366344.095412:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366344.095414:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366344.095416:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8687 00000100:00080000:0.0:1736366344.095418:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366344.095421:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366344.095424:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f79c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013048512:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366344.095430:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f7e880 x1820703013048704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366344.095434:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1736366344.095443:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366344.095446:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366344.095447:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366344.095449:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8687 00000100:00080000:0.0:1736366344.095451:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:1.0:1736366344.095453:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013048768:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366344.095454:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366344.095463:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f7f200 x1820703013048832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366344.095483:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366344.095486:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366344.095487:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366344.095490:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8687 00000100:00080000:0.0:1736366344.095491:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:2.0:1736366344.095495:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366344.095500:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366344.095506:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366344.095510:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880091f7af80 x1820703013049024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366344.095534:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013048576:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366344.095534:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013048640:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366344.095549:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013048960:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366344.095553:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366344.095573:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366344.095583:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048768 00000100:00100000:3.0:1736366344.095584:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048512 00000100:00100000:0.0:1736366344.095590:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013048704:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366344.095596:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366344.095607:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366344.095614:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048640 00000100:00100000:0.0:1736366344.095618:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013048832:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366344.095620:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736366344.095626:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048576 00000100:00100000:2.0:1736366344.095628:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013048896:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366344.095628:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1736366344.095634:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048704 00000100:00100000:3.0:1736366344.095637:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013048512:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366344.095638:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366344.095642:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:0.0:1736366344.095651:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013049024:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366344.095657:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086934280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013048768:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366344.095657:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366344.095668:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366344.095691:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048960 00000100:00100000:0.0:1736366344.095698:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049024 00000100:00100000:1.0:1736366344.095698:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086934280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013048768:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366344.095705:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1736366344.095707:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013048512:12345-0@lo:400:kworker/u8:0.0 Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366344.095715:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:3.0:1736366344.095717:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1736366344.095721:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086932f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013048640:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366344.095722:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1736366344.095723:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048896 00000100:00100000:1.0:1736366344.095726:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013048576:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366344.095737:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366344.095744:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7283 00000100:00100000:2.0:1736366344.095750:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013048960:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366344.095755:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086932f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013048640:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366344.095758:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7284 00000100:00100000:0.0:1736366344.095763:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1736366344.095763:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013048576:12345-0@lo:38:kworker/u8:0.0 Request processed in 35us (190us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366344.095764:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137129c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013048896:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366344.095769:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:0.0:1736366344.095777:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:0.0:1736366344.095781:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f78e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013048704:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366344.095782:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1736366344.095785:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013049024:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366344.095791:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736366344.095791:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366344.095795:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013048960:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366344.095795:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137129c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013048896:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366344.095805:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7283 00000100:00100000:1.0:1736366344.095808:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013049024:12345-0@lo:38:kworker/u8:0.0 Request processed in 22us (139us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366344.095811:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f78e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013048704:12345-0@lo:38:kworker/u8:0.0 Request processed in 30us (204us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366344.095813:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:0.0:1736366344.095818:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1736366344.095819:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7284 00000100:00100000:3.0:1736366344.095847:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013048832 00000100:00080000:0.0:1736366344.095853:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736366344.095853:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013048768:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366344.095854:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013048896:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366344.095856:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366344.095907:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013048960:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366344.095908:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77099 00000100:00100000:1.0:1736366344.095909:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013048640:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366344.095914:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013048832:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366344.095920:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f79c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013048512:0@lo:400:kworker/u8:0.0 00010000:02000000:3.0:1736366344.095927:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366344.095964:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013048832:12345-0@lo:38:kworker/u8:0.0 Request processed in 49us (327us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366344.095973:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77099 00000100:00100000:0.0:1736366344.095975:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013048576:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366344.095993:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366344.095995:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366344.095998:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013048704:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366344.096005:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366344.096007:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366344.096009:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013048832:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366344.096015:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366344.096017:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366344.096019:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013049024:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366344.195396:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366345.197399:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366346.199406:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366346.847471:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013049088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366346.847541:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366346.847647:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049088 00000100:00100000:2.0:1736366346.847705:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5930 00000100:00100000:2.0:1736366346.847711:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a3900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013049088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366346.847745:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366346.847800:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a3900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013049088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366346.847807:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5930 00000100:00100000:0.0:1736366346.847877:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013049088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366346.863382:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013049152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366346.863432:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366346.863498:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049152 00000100:00100000:3.0:1736366346.863549:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5931 00000100:00100000:3.0:1736366346.863554:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013049152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1736366346.863577:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:3.0:1736366346.863629:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013049152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366346.863656:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5931 00000100:00100000:2.0:1736366346.863692:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013049152:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366347.201418:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366348.203437:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366348.880289:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366348.880335:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366348.880383:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366348.880423:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022144 00000100:00100000:3.0:1736366348.880424:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022016 00000100:00100000:1.0:1736366348.880462:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022080 00000100:00100000:0.0:1736366348.880465:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 792 00000100:00100000:0.0:1736366348.880472:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1877:x1820703041022144:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366348.880487:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 253 00000100:00100000:3.0:1736366348.880496:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1876:x1820703041022016:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366348.880499:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1030 00000100:00100000:1.0:1736366348.880504:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041022080:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366348.880521:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366348.880543:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1877:x1820703041022144:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 70us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366348.880550:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1876:x1820703041022016:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 53us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366348.880551:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 792 00000100:00100000:3.0:1736366348.880562:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 253 00000100:00100000:1.0:1736366348.880570:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041022080:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 65us (187us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366348.880595:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1030 00000100:00080000:0.0:1736366349.103328:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366349.103346:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366349.103350:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366349.103356:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8692 00000100:00080000:0.0:1736366349.103360:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366349.103366:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366349.103386:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800797a5580 x1820703013049280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366349.103409:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366349.103412:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366349.103413:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366349.103416:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8692 00000100:00080000:0.0:1736366349.103418:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366349.103421:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366349.103427:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013049216:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366349.103428:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800797a3dc0 x1820703013049408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366349.103435:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013049344:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366349.103458:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366349.103461:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366349.103462:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366349.103465:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8692 00000100:00080000:0.0:1736366349.103467:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366349.103470:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366349.103479:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800797a5a40 x1820703013049536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366349.103498:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366349.103501:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366349.103508:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366349.103509:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366349.103511:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8692 00000100:00080000:0.0:1736366349.103513:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366349.103517:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366349.103519:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366349.103519:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013049472:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366349.103526:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800797a1300 x1820703013049728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366349.103542:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013049664:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366349.103551:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013049280:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366349.103561:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366349.103567:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366349.103573:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013049600:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366349.103592:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366349.103606:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366349.103610:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013049408:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366349.103610:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049216 00000100:00100000:1.0:1736366349.103614:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049344 00000100:00100000:0.0:1736366349.103630:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366349.103641:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013049536:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366349.103644:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049664 00000100:00100000:1.0:1736366349.103646:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049472 00000100:00100000:3.0:1736366349.103648:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1736366349.103656:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013049216:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366349.103659:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049280 00000100:00100000:0.0:1736366349.103661:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366349.103667:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049408 00000100:00100000:0.0:1736366349.103670:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013049728:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366349.103672:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049600 00000100:00100000:1.0:1736366349.103675:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:1.0:1736366349.103679:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013049344:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366349.103685:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366349.103692:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7285 00000100:00100000:2.0:1736366349.103698:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086935f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013049664:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366349.103711:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013049216:12345-0@lo:400:kworker/u8:0.0 Request processed in 55us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366349.103715:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049728 00000100:00100000:1.0:1736366349.103717:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013049344:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366349.103721:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1736366349.103724:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:0.0:1736366349.103734:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:2.0:1736366349.103738:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086935f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013049664:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366349.103739:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:0.0:1736366349.103740:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013049472:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366349.103742:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013049280:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366349.103747:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7285 00010000:02000000:1.0:1736366349.103754:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366349.103761:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049536 00000100:00100000:2.0:1736366349.103762:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7286 00000100:00100000:2.0:1736366349.103767:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013049600:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366349.103776:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013049472:12345-0@lo:400:kworker/u8:0.0 Request processed in 37us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366349.103779:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013049280:12345-0@lo:38:kworker/u8:0.0 Request processed in 36us (187us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366349.103810:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:3.0:1736366349.103815:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77100 00000100:00100000:3.0:1736366349.103822:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013049536:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366349.103824:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:0.0:1736366349.103828:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1736366349.103831:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013049408:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366349.103836:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00010000:02000000:3.0:1736366349.103836:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366349.103840:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013049728:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366349.103840:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013049600:12345-0@lo:400:kworker/u8:0.0 Request processed in 72us (234us total) trans 0 rc 0/0 00010000:02000000:0.0:1736366349.103841:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736366349.103847:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366349.103866:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7286 00000100:00100000:0.0:1736366349.103868:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013049408:12345-0@lo:38:kworker/u8:0.0 Request processed in 36us (237us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366349.103875:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013049728:12345-0@lo:38:kworker/u8:0.0 Request processed in 33us (189us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366349.103875:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013049536:12345-0@lo:38:kworker/u8:0.0 Request processed in 53us (213us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366349.103880:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1736366349.103884:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77100 00000100:00100000:0.0:1736366349.103897:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:2.0:1736366349.103929:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013049600:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366349.103929:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013049472:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366349.103931:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366349.103934:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366349.103937:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013049280:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366349.103937:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013049344:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366349.103945:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366349.103947:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366349.103949:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013049408:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366349.103957:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366349.103959:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366349.103961:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013049536:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366349.103961:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013049664:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366349.103968:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366349.103970:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366349.103970:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013049216:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366349.103973:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013049728:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366349.205401:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366350.207406:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366351.209396:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366351.855481:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d208980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013049792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366351.855551:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366351.855636:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049792 00000100:00100000:3.0:1736366351.855700:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5932 00000100:00100000:3.0:1736366351.855707:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086933dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013049792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1736366351.855776:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:3.0:1736366351.855839:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086933dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013049792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366351.855847:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5932 00000100:00100000:1.0:1736366351.855890:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d208980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013049792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366351.871372:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736366351.871389:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013049856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366351.871443:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366351.871514:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049856 00000100:00100000:3.0:1736366351.871562:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5933 00000100:00100000:3.0:1736366351.871567:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013645a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013049856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1736366351.871589:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:3.0:1736366351.871639:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013645a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013049856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366351.871649:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5933 00000100:00100000:2.0:1736366351.871700:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013049856:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366352.211415:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366353.213412:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366353.888211:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366353.888259:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366353.888300:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366353.888348:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022272 00000100:00100000:3.0:1736366353.888400:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022208 00000100:00100000:2.0:1736366353.888403:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022336 00000100:00100000:1.0:1736366353.888432:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 795 00000100:00100000:1.0:1736366353.888442:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041022336:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366353.888442:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1034 00000100:00100000:3.0:1736366353.888443:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 255 00000100:00100000:2.0:1736366353.888448:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041022272:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366353.888449:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041022208:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:2.0:1736366353.888466:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366353.888519:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041022208:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 69us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366353.888520:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041022336:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366353.888523:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041022272:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 75us (321us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366353.888527:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 255 00000100:00100000:1.0:1736366353.888528:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 795 00000100:00100000:2.0:1736366353.888532:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1034 00000100:00080000:0.0:1736366354.111318:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366354.111325:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366354.111328:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366354.111333:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8697 00000100:00080000:0.0:1736366354.111337:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366354.111343:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366354.111361:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d2097c0 x1820703013049984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366354.111413:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366354.111416:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366354.111418:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736366354.111418:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013049920:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366354.111421:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8697 00000100:00080000:0.0:1736366354.111423:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366354.111426:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366354.111435:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d20f6c0 x1820703013050112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366354.111448:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366354.111450:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366354.111452:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736366354.111452:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013050048:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366354.111454:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8697 00000100:00080000:0.0:1736366354.111456:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366354.111459:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366354.111466:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d20a600 x1820703013050240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366354.111479:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366354.111486:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366354.111489:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366354.111490:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366354.111493:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8697 00000100:00080000:0.0:1736366354.111494:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366354.111497:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366354.111498:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2097c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013049984:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366354.111505:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d20cc00 x1820703013050432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366354.111511:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d209c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013050368:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366354.111511:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366354.111537:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013050176:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366354.111544:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366354.111548:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366354.111552:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013050304:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366354.111573:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013050112:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366354.111575:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049920 00000100:00100000:0.0:1736366354.111583:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366354.111589:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366354.111603:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1736366354.111605:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050048 00000100:00100000:2.0:1736366354.111608:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013049920:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366354.111633:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013049984 00000100:00100000:3.0:1736366354.111637:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050368 00000100:00100000:0.0:1736366354.111638:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050176 00000100:00100000:2.0:1736366354.111643:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013049920:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366354.111648:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:1.0:1736366354.111652:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013050048:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366354.111660:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1736366354.111662:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050304 00000100:00100000:0.0:1736366354.111665:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:0.0:1736366354.111670:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013050176:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366354.111677:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7287 00000100:00100000:3.0:1736366354.111682:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013050368:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366354.111692:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7288 00000100:00100000:1.0:1736366354.111693:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013050048:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366354.111736:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:2.0:1736366354.111736:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013050304:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366354.111741:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013050176:12345-0@lo:400:kworker/u8:0.0 Request processed in 70us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366354.111748:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1736366354.111751:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013050368:12345-0@lo:400:kworker/u8:0.0 Request processed in 68us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366354.111752:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1736366354.111758:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7287 00000100:00100000:1.0:1736366354.111767:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086931c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013049984:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366354.111775:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013050304:12345-0@lo:400:kworker/u8:0.0 Request processed in 77us (185us total) trans 0 rc 0/0 00010000:02000000:1.0:1736366354.111779:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366354.111781:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7288 00000100:00100000:0.0:1736366354.111795:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013050176:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366354.111797:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013050048:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366354.111809:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086931c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013049984:12345-0@lo:38:kworker/u8:0.0 Request processed in 43us (261us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366354.111815:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:2.0:1736366354.111815:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013050304:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366354.111835:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366354.111839:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d209c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013050368:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366354.111846:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013049920:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366354.111849:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013050240:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366354.111858:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050112 00000100:00100000:1.0:1736366354.111870:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366354.111882:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1736366354.111885:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013050432:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366354.111886:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086936d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013050112:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366354.111895:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050240 00010000:02000000:0.0:1736366354.111896:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366354.111899:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366354.111912:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77101 00000100:00100000:2.0:1736366354.111916:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086934c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013050240:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366354.111918:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366354.111921:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366354.111925:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086936d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013050112:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (90us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366354.111925:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2097c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013049984:0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366354.111926:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366354.111928:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050432 00000100:00100000:0.0:1736366354.111932:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00080000:1.0:1736366354.111933:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366354.111935:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366354.111938:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013050112:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366354.111942:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:0.0:1736366354.111946:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086930980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013050432:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366354.111952:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366354.111952:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086934c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013050240:12345-0@lo:38:kworker/u8:0.0 Request processed in 35us (82us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366354.111958:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366354.111958:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77101 00000100:00080000:1.0:1736366354.111960:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366354.111962:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013050240:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366354.111967:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086930980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013050432:12345-0@lo:38:kworker/u8:0.0 Request processed in 21us (68us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366354.111972:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00080000:1.0:1736366354.111973:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366354.111975:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366354.111978:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013050432:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366354.215413:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366355.217403:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366356.219405:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366356.863509:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880086930e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013050496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366356.863581:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366356.863709:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050496 00000100:00100000:0.0:1736366356.863773:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5934 00000100:00100000:0.0:1736366356.863780:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cac280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013050496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366356.863814:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366356.863875:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cac280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013050496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366356.863897:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5934 00000100:00100000:3.0:1736366356.863927:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880086930e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013050496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366356.879414:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013050560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366356.879455:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366356.879518:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050560 00000100:00100000:2.0:1736366356.879569:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5935 00000100:00100000:2.0:1736366356.879574:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013050560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366356.879597:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366356.879642:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013050560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366356.879686:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013050560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366356.879688:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5935 00010000:00010000:1.0:1736366357.221418:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366358.223416:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366358.896279:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366358.896333:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366358.896379:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366358.896445:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022528 00000100:00100000:3.0:1736366358.896469:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022400 00000100:00100000:2.0:1736366358.896496:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022464 00000100:00100000:1.0:1736366358.896509:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 798 00000100:00100000:3.0:1736366358.896514:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 257 00000100:00100000:3.0:1736366358.896521:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013063e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041022400:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366358.896533:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041022528:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366358.896540:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1038 00000100:00100000:2.0:1736366358.896546:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041022464:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:2.0:1736366358.896563:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366358.896606:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013063e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041022400:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 85us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366358.896615:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041022528:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 84us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366358.896616:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 257 00000100:00100000:2.0:1736366358.896642:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041022464:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 68us (236us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366358.896651:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1038 00000100:00100000:1.0:1736366358.896682:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 798 00000100:00080000:0.0:1736366359.119321:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366359.119327:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366359.119331:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366359.119337:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8702 00000100:00080000:0.0:1736366359.119341:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366359.119346:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366359.119363:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d20f6c0 x1820703013050688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366359.119392:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366359.119395:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366359.119397:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366359.119399:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8702 00000100:00080000:0.0:1736366359.119401:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366359.119404:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366359.119411:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d20d580 x1820703013050816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366359.119428:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013050624:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366359.119428:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2097c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013050752:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366359.119432:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366359.119447:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366359.119448:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366359.119451:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8702 00000100:00080000:0.0:1736366359.119453:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366359.119456:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366359.119467:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d20c280 x1820703013050944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366359.119487:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366359.119490:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366359.119491:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366359.119494:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8702 00000100:00080000:0.0:1736366359.119495:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1736366359.119495:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013050688:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366359.119497:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366359.119505:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366359.119505:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366359.119507:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b138980 x1820703013051136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366359.119531:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013051008:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366359.119544:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d208980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013051072:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366359.119547:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366359.119553:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d209c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013050880:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366359.119580:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366359.119590:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013050816:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366359.119603:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366359.119604:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366359.119658:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050752 00000100:00100000:0.0:1736366359.119659:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050688 00000100:00100000:2.0:1736366359.119680:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050624 00000100:00100000:3.0:1736366359.119680:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051008 00000100:00100000:0.0:1736366359.119683:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050880 00000100:00100000:1.0:1736366359.119692:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1736366359.119697:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013050752:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366359.119704:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:0.0:1736366359.119709:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caf6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013050880:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366359.119712:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051072 00000100:00100000:2.0:1736366359.119714:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1736366359.119721:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013050624:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366359.119731:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7289 00000100:00100000:3.0:1736366359.119736:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b139c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013051008:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366359.119741:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013050752:12345-0@lo:400:kworker/u8:0.0 Request processed in 44us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366359.119749:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1736366359.119750:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caf6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013050880:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366359.119756:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1736366359.119763:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1736366359.119767:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086933900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013050688:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366359.119773:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013050624:12345-0@lo:400:kworker/u8:0.0 Request processed in 51us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366359.119776:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b139c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013051008:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (197us total) trans 0 rc 0/0 00010000:02000000:1.0:1736366359.119778:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366359.119784:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1736366359.119785:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7289 00000100:00100000:1.0:1736366359.119801:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086933900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013050688:12345-0@lo:38:kworker/u8:0.0 Request processed in 33us (255us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366359.119801:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7290 00000100:00100000:0.0:1736366359.119803:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013051008:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366359.119807:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1736366359.119807:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013051072:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366359.119834:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013050624:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366359.119837:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2097c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013050752:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366359.119839:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013051072:12345-0@lo:400:kworker/u8:0.0 Request processed in 33us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366359.119848:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d209c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013050880:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366359.119849:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7290 00000100:00100000:1.0:1736366359.119857:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366359.119860:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d208980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013051072:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366359.119869:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013050944:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366359.119882:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050816 00000100:00100000:1.0:1736366359.119892:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366359.119904:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1736366359.119906:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013051136:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366359.119910:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086930e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013050816:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366359.119923:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366359.119928:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013050944 00000100:00100000:1.0:1736366359.119936:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366359.119952:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77102 00000100:00100000:3.0:1736366359.119957:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086930e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013050816:12345-0@lo:38:kworker/u8:0.0 Request processed in 47us (99us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366359.119958:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086933dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013050944:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366359.119966:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00080000:1.0:1736366359.119972:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366359.119975:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00010000:02000000:2.0:1736366359.119977:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366359.119979:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013050688:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366359.119979:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051136 00000100:00080000:1.0:1736366359.119987:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366359.119989:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366359.119991:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013050816:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366359.119996:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1736366359.120001:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f79300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013051136:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366359.120010:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366359.120011:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086933dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013050944:12345-0@lo:38:kworker/u8:0.0 Request processed in 53us (118us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366359.120012:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366359.120014:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366359.120017:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013050944:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366359.120021:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77102 00000100:00100000:3.0:1736366359.120042:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f79300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013051136:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (105us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736366359.120061:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366359.120064:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00080000:0.0:1736366359.120065:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366359.120069:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013051136:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366359.225404:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366360.227406:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366361.229419:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366361.871484:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131caed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013051200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366361.871555:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366361.871650:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051200 00000100:00100000:2.0:1736366361.871712:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5936 00000100:00100000:2.0:1736366361.871718:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013051200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366361.871750:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366361.871812:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013051200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366361.871820:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5936 00000100:00100000:1.0:1736366361.871858:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131caed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013051200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366361.887422:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736366361.887439:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013051264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366361.887477:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366361.887535:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051264 00000100:00100000:2.0:1736366361.887601:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5937 00000100:00100000:2.0:1736366361.887606:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013051264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366361.887638:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366361.887691:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013051264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366361.887698:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5937 00000100:00100000:1.0:1736366361.887731:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013051264:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366362.231422:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366363.233381:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366363.904314:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366363.904377:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366363.904432:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366363.904482:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022720 00000100:00100000:2.0:1736366363.904482:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022592 00000100:00100000:2.0:1736366363.904561:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 259 00000100:00100000:1.0:1736366363.904566:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022656 00000100:00100000:2.0:1736366363.904572:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041022592:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366363.904585:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 801 00000100:00100000:1.0:1736366363.904591:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041022720:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366363.904609:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1042 00000100:00100000:3.0:1736366363.904617:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041022656:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366363.904635:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366363.904652:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041022720:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 61us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366363.904652:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041022592:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 80us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366363.904664:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 259 00000100:00100000:1.0:1736366363.904673:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 801 00000100:00100000:3.0:1736366363.904677:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041022656:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 60us (247us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366363.904685:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1042 00000100:00080000:0.0:1736366364.127352:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366364.127362:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366364.127367:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366364.127376:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8707 00000100:00080000:0.0:1736366364.127381:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366364.127388:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366364.127411:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736366364.127415:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13cc00 x1820703013051392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366364.127431:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013051328:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366364.127459:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013051392:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366364.127475:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366364.127481:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366364.127483:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366364.127487:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8707 00000100:00080000:0.0:1736366364.127490:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366364.127494:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366364.127504:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366364.127511:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13da40 x1820703013051520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366364.127529:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366364.127577:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051328 00000100:00100000:1.0:1736366364.127584:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013051520:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366364.127589:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736366364.127595:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051392 00000100:00100000:1.0:1736366364.127605:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366364.127608:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366364.127610:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736366364.127610:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00080000:0.0:1736366364.127615:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8707 00000100:00100000:2.0:1736366364.127616:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013051328:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366364.127619:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366364.127625:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366364.127628:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013051584:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366364.127629:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051520 00000100:00100000:0.0:1736366364.127644:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b139300 x1820703013051648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366364.127644:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1736366364.127649:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013051392:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366364.127651:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366364.127658:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013051328:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366364.127664:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:02000000:3.0:1736366364.127664:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366364.127665:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1736366364.127669:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013051456:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366364.127689:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366364.127689:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366364.127693:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366364.127695:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736366364.127695:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1397c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013051712:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366364.127700:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8707 00000100:00080000:0.0:1736366364.127702:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366364.127708:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366364.127708:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013051392:12345-0@lo:38:kworker/u8:0.0 Request processed in 58us (179us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366364.127713:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051584 00000100:00100000:3.0:1736366364.127715:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:2.0:1736366364.127718:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366364.127722:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13df00 x1820703013051840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366364.127726:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051456 00000100:00100000:1.0:1736366364.127737:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1736366364.127742:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f79c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013051584:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366364.127743:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013051328:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366364.127753:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:3.0:1736366364.127756:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013051456:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366364.127760:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736366364.127764:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013051776:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366364.127765:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1736366364.127773:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013051520:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366364.127777:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f79c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013051584:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366364.127783:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00010000:02000000:0.0:1736366364.127787:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366364.127788:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366364.127792:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013051456:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366364.127797:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:2.0:1736366364.127809:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051712 00000100:00100000:1.0:1736366364.127812:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013051456:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366364.127819:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051776 00000100:00100000:1.0:1736366364.127820:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013051584:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366364.127830:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7291 00000100:00100000:2.0:1736366364.127834:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371297c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013051712:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366364.127839:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7292 00000100:00100000:0.0:1736366364.127840:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013051520:12345-0@lo:38:kworker/u8:0.0 Request processed in 66us (231us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366364.127843:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013051776:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366364.127846:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013051648:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366364.127850:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1736366364.127866:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371297c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013051712:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366364.127871:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366364.127872:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7291 00000100:00100000:1.0:1736366364.127885:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013051840:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366364.127888:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013051776:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366364.127894:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7292 00000100:00100000:2.0:1736366364.127898:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013051776:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366364.127901:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366364.127906:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b1397c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013051712:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366364.127914:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051648 00000100:00080000:1.0:1736366364.127916:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366364.127928:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366364.127932:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013051520:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366364.127942:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366364.127944:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77103 00000100:00080000:1.0:1736366364.127944:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366364.127947:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013051392:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366364.127951:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013051648:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366364.127962:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366364.128006:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013051648:12345-0@lo:38:kworker/u8:0.0 Request processed in 53us (132us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366364.128017:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366364.128020:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366364.128023:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013051648:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366364.128027:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77103 00000100:00100000:0.0:1736366364.128066:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051840 00000100:00100000:0.0:1736366364.128107:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1736366364.128113:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013051840:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366364.128124:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736366364.128211:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366364.128214:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013051840:12345-0@lo:38:kworker/u8:0.0 Request processed in 98us (310us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366364.128214:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366364.128217:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013051840:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366364.128223:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00010000:00010000:3.0:1736366364.235404:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366365.237401:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366366.239364:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366366.879564:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366366.879591:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013051904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366366.879665:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366366.879822:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051904 00000100:00100000:2.0:1736366366.879884:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5938 00000100:00100000:2.0:1736366366.879890:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013051904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366366.879926:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366366.879979:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013051904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366366.879986:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5938 00000100:00100000:0.0:1736366366.880006:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013051904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366366.895363:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880091f7b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013051968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366366.895407:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366366.895558:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013051968 00000100:00100000:2.0:1736366366.895605:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5939 00000100:00100000:2.0:1736366366.895610:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b139300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013051968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366366.895636:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366366.895679:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b139300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013051968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366366.895686:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5939 00000100:00100000:0.0:1736366366.895702:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880091f7b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013051968:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366367.241370:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366368.243412:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366368.912084:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366368.912138:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022912 00000100:00100000:0.0:1736366368.912151:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366368.912253:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 804 00000100:00100000:0.0:1736366368.912254:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366368.912262:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041022912:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366368.912267:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022784 00000100:00100000:0.0:1736366368.912283:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022848 00000100:00100000:0.0:1736366368.912313:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1046 00000100:00100000:2.0:1736366368.912316:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 261 00000100:00100000:0.0:1736366368.912320:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041022848:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:2.0:1736366368.912325:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041022784:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:0.0:1736366368.912339:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366368.912346:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041022912:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 85us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366368.912357:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 804 00000100:00100000:2.0:1736366368.912380:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041022784:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 53us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366368.912390:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041022848:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 68us (138us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366368.912390:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 261 00000100:00100000:0.0:1736366368.912400:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1046 00000100:00080000:0.0:1736366369.135328:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366369.135336:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366369.135340:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366369.135348:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8712 00000100:00080000:0.0:1736366369.135353:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366369.135360:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366369.135384:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1397c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013052032:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366369.135386:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13f6c0 x1820703013052096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366369.135421:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366369.135422:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013052096:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366369.135426:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366369.135428:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366369.135432:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8712 00000100:00080000:0.0:1736366369.135435:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366369.135439:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366369.135477:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13e3c0 x1820703013052224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366369.135493:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366369.135509:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366369.135521:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366369.135525:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366369.135527:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366369.135532:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8712 00000100:00080000:0.0:1736366369.135534:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366369.135539:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366369.135548:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013052224:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366369.135550:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736366369.135553:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b138980 x1820703013052352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366369.135559:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013052160:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366369.135580:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366369.135584:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736366369.135599:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366369.135603:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013052352:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366369.135604:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366369.135607:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366369.135611:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8712 00000100:00080000:0.0:1736366369.135614:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366369.135618:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366369.135630:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052096 00000100:00100000:0.0:1736366369.135633:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d20f6c0 x1820703013052544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366369.135644:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013052480:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366369.135647:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366369.135665:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013052416:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366369.135667:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052224 00000100:00100000:1.0:1736366369.135670:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013052544:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366369.135678:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052160 00000100:00100000:2.0:1736366369.135679:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366369.135698:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366369.135698:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366369.135702:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:3.0:1736366369.135708:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013052160:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366369.135719:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736366369.135723:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052480 00000100:00100000:0.0:1736366369.135727:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013052288:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366369.135730:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052352 00000100:00100000:2.0:1736366369.135757:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052416 00000100:00100000:0.0:1736366369.135758:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366369.135758:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77104 00000100:00100000:1.0:1736366369.135765:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095174740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013052352:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366369.135765:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013052160:12345-0@lo:400:kworker/u8:0.0 Request processed in 56us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366369.135772:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:2.0:1736366369.135779:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7293 00010000:02000000:1.0:1736366369.135781:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366369.135786:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7294 00000100:00100000:2.0:1736366369.135786:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013052480:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366369.135786:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052544 00000100:00100000:0.0:1736366369.135793:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d208980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013052416:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366369.135793:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052288 00000100:00100000:3.0:1736366369.135803:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:3.0:1736366369.135807:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d209c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013052288:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366369.135822:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095174740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013052352:12345-0@lo:38:kworker/u8:0.0 Request processed in 56us (174us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366369.135832:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77104 00000100:00100000:2.0:1736366369.135842:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013052480:12345-0@lo:400:kworker/u8:0.0 Request processed in 55us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366369.135845:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d209c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013052288:12345-0@lo:400:kworker/u8:0.0 Request processed in 37us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366369.135846:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d208980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013052416:12345-0@lo:400:kworker/u8:0.0 Request processed in 52us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366369.135850:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1736366369.135852:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7293 00000100:00100000:0.0:1736366369.135857:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7294 00000100:00100000:3.0:1736366369.135859:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1736366369.135862:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013052096:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366369.135865:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:1.0:1736366369.135870:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095174280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013052224:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366369.135872:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736366369.135881:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366369.135894:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1736366369.135900:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951763c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013052544:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366369.135903:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013052288:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366369.135906:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013052096:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (399us total) trans 0 rc -19/-19 00010000:02000000:2.0:1736366369.135913:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366369.135913:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1736366369.135917:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013052416:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366369.135918:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095174280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013052224:12345-0@lo:38:kworker/u8:0.0 Request processed in 47us (337us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366369.135926:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:3.0:1736366369.135949:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052032 00000100:00100000:2.0:1736366369.135950:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951763c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013052544:12345-0@lo:38:kworker/u8:0.0 Request processed in 49us (252us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366369.135959:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00080000:1.0:1736366369.135966:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366369.135970:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366369.135975:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013052544:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366369.135983:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1736366369.135986:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013052032:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366369.135988:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366369.135991:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366369.135995:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013052352:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366369.135998:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013052480:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366369.136007:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366369.136010:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366369.136011:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013052160:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366369.136014:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013052224:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366369.136017:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013052032:12345-0@lo:400:kworker/u8:0.0 Request processed in 30us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366369.136022:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1736366369.136024:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b1397c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013052032:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366369.136037:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366369.136039:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366369.136042:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013052096:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366369.245401:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366370.247426:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366371.249409:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366371.887491:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013052608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366371.887558:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366371.887614:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052608 00000100:00100000:2.0:1736366371.887666:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5940 00000100:00100000:2.0:1736366371.887671:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013052608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366371.887700:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366371.887750:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013052608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366371.887770:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5940 00000100:00100000:1.0:1736366371.887791:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013052608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366371.903289:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736366371.903300:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013052672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366371.903323:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366371.903420:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052672 00000100:00100000:2.0:1736366371.903465:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5941 00000100:00100000:2.0:1736366371.903468:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013052672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366371.903483:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366371.903514:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013052672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366371.903519:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5941 00000100:00100000:1.0:1736366371.903540:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013052672:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366372.251284:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366373.253457:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:0.0:1736366373.566320:0:17953:0:(genops.c:1786:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 128 seconds. The obd refcount = 4. Is it stuck? 00000020:02000400:0.0:1736366373.572629:0:17953:0:(genops.c:1752:print_export_data()) lustre-MDT0000: UNLINKED ffff88012c763800 cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 192.168.201.2@tcp 1 (0 0 0) 1 0 1 0: (null) 536870912003 stale:0 00000100:00100000:0.0:1736366373.920279:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366373.920324:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366373.920363:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366373.920436:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023104 00000100:00100000:3.0:1736366373.920438:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023040 00000100:00100000:1.0:1736366373.920458:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041022976 00000100:00100000:3.0:1736366373.920483:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 807 00000100:00100000:3.0:1736366373.920491:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d2097c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041023104:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366373.920495:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1050 00000100:00100000:0.0:1736366373.920500:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041023040:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:1.0:1736366373.920500:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 263 00000100:00100000:1.0:1736366373.920506:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041022976:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:0.0:1736366373.920518:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366373.920567:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041022976:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 60us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366373.920569:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d2097c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041023104:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 79us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366373.920572:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041023040:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 72us (209us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366373.920575:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 263 00000100:00100000:3.0:1736366373.920576:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 807 00000100:00100000:0.0:1736366373.920580:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1050 00000100:00080000:0.0:1736366374.143322:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366374.143328:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366374.143331:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366374.143338:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8717 00000100:00080000:0.0:1736366374.143341:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366374.143347:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366374.143401:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d20c280 x1820703013052800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366374.143439:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366374.143443:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366374.143444:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366374.143447:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8717 00000100:00080000:0.0:1736366374.143449:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366374.143452:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366374.143455:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013052736:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366374.143461:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d20d580 x1820703013052928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366374.143463:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1736366374.143476:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366374.143479:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1736366374.143480:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013052864:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366374.143491:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1736366374.143493:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366374.143497:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8717 00000100:00080000:0.0:1736366374.143498:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366374.143502:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366374.143506:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013052992:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366374.143513:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13e3c0 x1820703013053056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366374.143536:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366374.143537:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366374.143539:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366374.143540:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366374.143543:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8717 00000100:00080000:0.0:1736366374.143545:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366374.143547:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366374.143547:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366374.143555:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b138000 x1820703013053248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366374.143576:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1397c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013053184:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366374.143588:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013052800:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366374.143604:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366374.143606:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052864 00000100:00100000:1.0:1736366374.143611:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366374.143627:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366374.143631:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736366374.143639:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013053120:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366374.143643:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013052928:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366374.143647:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052992 00000100:00100000:2.0:1736366374.143653:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052800 00000100:00100000:0.0:1736366374.143660:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366374.143663:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1736366374.143669:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013052864:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366374.143674:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052928 00000100:00100000:0.0:1736366374.143675:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013053056:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366374.143684:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366374.143688:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1736366374.143694:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366374.143696:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013052992:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366374.143708:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013053248:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366374.143716:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013052864:12345-0@lo:400:kworker/u8:0.0 Request processed in 47us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366374.143718:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053184 00000100:00100000:3.0:1736366374.143723:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:0.0:1736366374.143724:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366374.143739:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053248 00000100:00100000:2.0:1736366374.143749:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013052992:12345-0@lo:400:kworker/u8:0.0 Request processed in 53us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366374.143750:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:1.0:1736366374.143751:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053120 00000100:00100000:3.0:1736366374.143753:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013052800:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366374.143755:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1736366374.143762:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013052928:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366374.143762:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:1.0:1736366374.143773:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7295 00010000:02000000:0.0:1736366374.143776:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736366374.143776:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366374.143778:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013053184:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366374.143782:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:2.0:1736366374.143786:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd78e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013053248:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366374.143798:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366374.143815:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013052800:12345-0@lo:38:kworker/u8:0.0 Request processed in 61us (189us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366374.143819:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013052928:12345-0@lo:38:kworker/u8:0.0 Request processed in 58us (157us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366374.143823:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1736366374.143827:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:1.0:1736366374.143827:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013053184:12345-0@lo:400:kworker/u8:0.0 Request processed in 47us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366374.143829:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd78e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013053248:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (105us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366374.143836:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7295 00000100:00100000:2.0:1736366374.143838:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1736366374.143851:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7296 00000100:00100000:1.0:1736366374.143856:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013053120:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366374.143861:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366374.143863:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013052864:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366374.143864:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366374.143867:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013052800:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366374.143875:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366374.143877:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366374.143879:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013052928:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366374.143881:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013052992:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366374.143887:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366374.143889:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366374.143891:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013053248:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366374.143893:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013053120:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366374.143901:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7296 00000100:00100000:3.0:1736366374.143906:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053056 00000100:00100000:0.0:1736366374.143921:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013052736 00000100:00100000:3.0:1736366374.143924:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77105 00000100:00100000:3.0:1736366374.143928:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013053056:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366374.143933:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013053120:0@lo:400:kworker/u8:0.0 00010000:02000000:3.0:1736366374.143935:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366374.143947:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1736366374.143947:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b1397c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013053184:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366374.143952:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013052736:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366374.143961:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013053056:12345-0@lo:38:kworker/u8:0.0 Request processed in 32us (267us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366374.143967:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77105 00000100:00100000:0.0:1736366374.143996:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013052736:12345-0@lo:400:kworker/u8:0.0 Request processed in 44us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366374.144003:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1736366374.144021:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013052736:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366374.144038:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366374.144040:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366374.144043:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013053056:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366374.255440:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366375.257428:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366376.259390:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366376.895581:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013053312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366376.895654:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366376.895723:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053312 00000100:00100000:0.0:1736366376.895777:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5942 00000100:00100000:0.0:1736366376.895784:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013053312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366376.895831:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366376.895891:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013053312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366376.895900:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5942 00000100:00100000:2.0:1736366376.895929:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013053312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366376.911374:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736366376.911390:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013053376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366376.911427:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366376.911548:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053376 00000100:00100000:0.0:1736366376.911596:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5943 00000100:00100000:0.0:1736366376.911601:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013053376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366376.911623:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366376.911667:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013053376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366376.911673:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5943 00000100:00100000:2.0:1736366376.911687:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013053376:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366377.261430:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366378.263465:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366378.928256:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366378.928324:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366378.928362:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366378.928392:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023168 00000100:00100000:0.0:1736366378.928419:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023296 00000100:00100000:2.0:1736366378.928444:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 265 00000100:00100000:3.0:1736366378.928445:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023232 00000100:00100000:2.0:1736366378.928451:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041023168:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366378.928453:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 810 00000100:00100000:0.0:1736366378.928459:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041023296:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366378.928494:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1054 00000100:00100000:3.0:1736366378.928500:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd79300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041023232:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:0.0:1736366378.928516:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041023296:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 56us (192us total) trans 0 rc 0/0 00010000:02000000:3.0:1736366378.928517:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366378.928524:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 810 00000100:00100000:2.0:1736366378.928531:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041023168:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 77us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366378.928542:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 265 00000100:00100000:3.0:1736366378.928554:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd79300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041023232:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 54us (192us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366378.928561:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1054 00000100:00080000:0.0:1736366379.151345:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366379.151351:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366379.151354:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366379.151360:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8722 00000100:00080000:0.0:1736366379.151364:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366379.151381:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366379.151402:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cd7e880 x1820703013053504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366379.151425:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366379.151429:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366379.151430:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366379.151433:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8722 00000100:00080000:0.0:1736366379.151435:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366379.151437:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366379.151445:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cd7f200 x1820703013053632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366379.151446:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013053568:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366379.151446:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013053440:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366379.151473:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366379.151476:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366379.151477:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366379.151479:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8722 00000100:00080000:0.0:1736366379.151481:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366379.151483:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366379.151492:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cd7d0c0 x1820703013053760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366379.151510:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366379.151513:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366379.151514:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366379.151517:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8722 00000100:00080000:0.0:1736366379.151519:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366379.151521:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366379.151533:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366379.151533:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366379.151537:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cd78980 x1820703013053952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366379.151561:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013053504:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366379.151572:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd797c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013053888:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366379.151576:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013053696:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366379.151588:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053568 00000100:00100000:0.0:1736366379.151600:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366379.151610:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366379.151619:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013053632:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366379.151620:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366379.151643:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053504 00000100:00100000:2.0:1736366379.151645:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053888 00000100:00100000:0.0:1736366379.151651:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366379.151659:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736366379.151662:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013053760:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366379.151665:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd784c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013053824:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366379.151668:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053696 00000100:00100000:2.0:1736366379.151672:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7297 00000100:00100000:2.0:1736366379.151679:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137129300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013053888:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366379.151682:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053632 00000100:00100000:0.0:1736366379.151683:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366379.151688:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366379.151694:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd78980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013053952:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366379.151694:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:1.0:1736366379.151700:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013053568:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366379.151712:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366379.151736:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137129300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013053888:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366379.151736:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053952 00000100:00100000:0.0:1736366379.151743:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053760 00000100:00100000:1.0:1736366379.151754:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013053568:12345-0@lo:400:kworker/u8:0.0 Request processed in 54us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366379.151757:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:2.0:1736366379.151761:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7297 00000100:00100000:1.0:1736366379.151763:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:3.0:1736366379.151763:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013053696:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366379.151764:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77106 00000100:00100000:0.0:1736366379.151769:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013053760:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366379.151780:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366379.151784:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1736366379.151786:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053824 00000100:00100000:1.0:1736366379.151789:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013053504:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366379.151801:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366379.151803:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013053696:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366379.151810:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013053760:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (125us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366379.151810:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:2.0:1736366379.151811:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7298 00000100:00100000:2.0:1736366379.151816:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013053824:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366379.151817:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77106 00000100:00100000:3.0:1736366379.151825:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1736366379.151828:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013053632:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366379.151833:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013053504:12345-0@lo:38:kworker/u8:0.0 Request processed in 43us (232us total) trans 0 rc -19/-19 00010000:02000000:3.0:1736366379.151837:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366379.151842:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00080000:0.0:1736366379.151852:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366379.151855:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366379.151857:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1736366379.151857:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013053824:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366379.151859:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013053504:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366379.151861:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013053632:12345-0@lo:38:kworker/u8:0.0 Request processed in 32us (210us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366379.151862:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013053952:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366379.151865:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7298 00000100:00080000:0.0:1736366379.151867:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366379.151867:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00080000:0.0:1736366379.151869:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366379.151871:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013053632:0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366379.151873:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1736366379.151878:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366379.151886:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366379.151889:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013053760:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366379.151896:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013053440 00000100:00100000:3.0:1736366379.151898:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd784c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013053824:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366379.151901:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736366379.151902:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013053952:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (189us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736366379.151903:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366379.151905:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd78980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013053952:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366379.151907:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013053696:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366379.151912:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1736366379.151922:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1736366379.151927:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013053440:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366379.151958:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013053568:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366379.151958:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013053440:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366379.151966:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1736366379.152009:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd797c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013053888:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366379.152021:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013053440:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366379.265381:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366380.267442:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366381.269472:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366381.903485:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013054016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366381.903552:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366381.903705:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054016 00000100:00100000:0.0:1736366381.903762:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5944 00000100:00100000:0.0:1736366381.903768:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013054016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366381.903799:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366381.903856:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013054016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366381.903864:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5944 00000100:00100000:1.0:1736366381.903900:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013054016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366381.919378:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013054080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366381.919416:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366381.919470:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054080 00000100:00100000:0.0:1736366381.919508:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5945 00000100:00100000:0.0:1736366381.919513:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013054080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366381.919532:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366381.919574:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013054080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366381.919580:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5945 00000100:00100000:3.0:1736366381.919608:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013054080:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366382.271453:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366383.273509:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366383.936032:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366383.936078:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366383.936113:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366383.936155:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023488 00000100:00100000:3.0:1736366383.936191:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023360 00000100:00100000:0.0:1736366383.936248:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023424 00000100:00100000:1.0:1736366383.936263:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 813 00000100:00100000:3.0:1736366383.936265:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 267 00000100:00100000:3.0:1736366383.936272:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041023360:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366383.936276:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041023488:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366383.936283:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1058 00000100:00100000:0.0:1736366383.936288:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041023424:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:0.0:1736366383.936314:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366383.936345:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041023360:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 73us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366383.936353:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041023488:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366383.936353:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 267 00000100:00100000:0.0:1736366383.936364:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041023424:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 75us (251us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366383.936372:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1058 00000100:00100000:1.0:1736366383.936382:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 813 00000100:00080000:0.0:1736366384.159395:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366384.159401:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366384.159404:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366384.159410:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8727 00000100:00080000:0.0:1736366384.159413:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366384.159419:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366384.159436:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880073ab2600 x1820703013054208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366384.159462:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366384.159465:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366384.159465:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736366384.159467:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013054144:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366384.159468:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8727 00000100:00080000:0.0:1736366384.159469:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366384.159471:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366384.159477:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880073ab0980 x1820703013054336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366384.159485:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013054272:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366384.159488:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366384.159489:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366384.159490:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366384.159492:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8727 00000100:00080000:0.0:1736366384.159493:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1736366384.159507:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013054208:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366384.159509:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366384.159518:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880073ab2f80 x1820703013054464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366384.159539:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366384.159541:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366384.159542:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736366384.159542:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366384.159542:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366384.159544:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8727 00000100:00080000:0.0:1736366384.159545:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366384.159547:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366384.159553:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cd797c0 x1820703013054656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366384.159555:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013054400:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366384.159575:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013054592:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366384.159579:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013054528:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366384.159580:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366384.159595:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054272 00000100:00100000:2.0:1736366384.159604:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366384.159612:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366384.159621:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054400 00000100:00100000:1.0:1736366384.159626:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013054336:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366384.159627:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054208 00000100:00100000:2.0:1736366384.159636:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054592 00000100:00100000:0.0:1736366384.159639:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:0.0:1736366384.159645:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013054272:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366384.159645:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:1.0:1736366384.159647:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366384.159649:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad4c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013054400:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366384.159658:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073ab2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013054464:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366384.159662:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7299 00000100:00100000:2.0:1736366384.159667:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013054592:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366384.159690:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366384.159692:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad4c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013054400:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366384.159693:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013054272:12345-0@lo:400:kworker/u8:0.0 Request processed in 50us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366384.159698:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:0.0:1736366384.159700:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:1.0:1736366384.159705:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd797c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013054656:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366384.159711:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054336 00000100:00100000:2.0:1736366384.159713:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013054592:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366384.159715:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1736366384.159718:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013054208:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366384.159721:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1736366384.159722:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7299 00000100:00100000:3.0:1736366384.159723:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013054336:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366384.159727:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:0.0:1736366384.159729:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736366384.159731:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366384.159747:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054656 00000100:00100000:0.0:1736366384.159752:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013054208:12345-0@lo:38:kworker/u8:0.0 Request processed in 33us (141us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366384.159753:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013054336:12345-0@lo:38:kworker/u8:0.0 Request processed in 29us (107us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366384.159757:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:2.0:1736366384.159760:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013054592:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366384.159760:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:1.0:1736366384.159764:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:1.0:1736366384.159768:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880133144c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013054656:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366384.159776:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054464 00010000:02000000:1.0:1736366384.159777:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366384.159779:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366384.159785:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054144 00000100:00100000:0.0:1736366384.159786:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77107 00000100:00100000:0.0:1736366384.159795:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad5580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013054464:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366384.159801:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366384.159803:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880133144c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013054656:12345-0@lo:38:kworker/u8:0.0 Request processed in 34us (76us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366384.159808:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1736366384.159810:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:2.0:1736366384.159812:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013054144:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366384.159818:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad5580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013054464:12345-0@lo:38:kworker/u8:0.0 Request processed in 23us (129us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366384.159822:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77107 00000100:00100000:1.0:1736366384.159835:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013054400:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366384.159848:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013054272:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366384.159859:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013054144:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (318us total) trans 0 rc 0/0 00000100:00080000:1.0:1736366384.159860:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366384.159863:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366384.159866:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013054464:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366384.159866:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1736366384.159874:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366384.159882:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366384.159884:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013054144:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366384.159886:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd797c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013054656:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366384.159892:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054528 00000100:00080000:1.0:1736366384.159897:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366384.159899:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366384.159902:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013054208:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366384.159910:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366384.159910:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7300 00000100:00080000:1.0:1736366384.159913:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366384.159914:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013054528:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366384.159915:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013054336:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366384.159947:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013054528:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366384.159953:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013054528:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366384.159954:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7300 00010000:00010000:3.0:1736366384.275450:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366385.277411:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366386.279427:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366386.911457:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736366386.911479:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880133142ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013054720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366386.911546:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366386.911610:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054720 00000100:00100000:0.0:1736366386.911667:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5946 00000100:00100000:0.0:1736366386.911673:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013054720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366386.911704:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366386.911752:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013054720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366386.911759:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5946 00000100:00100000:2.0:1736366386.911776:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880133142ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013054720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366386.927408:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013054784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366386.927442:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366386.927466:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054784 00000100:00100000:0.0:1736366386.927495:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5947 00000100:00100000:0.0:1736366386.927500:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1397c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013054784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366386.927520:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366386.927566:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1397c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013054784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366386.927572:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5947 00000100:00100000:2.0:1736366386.927595:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013054784:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366387.281478:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366388.283456:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366388.944268:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366388.944314:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366388.944352:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366388.944395:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023680 00000100:00100000:3.0:1736366388.944399:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023552 00000100:00100000:1.0:1736366388.944428:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023616 00000100:00100000:3.0:1736366388.944444:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 269 00000100:00100000:0.0:1736366388.944447:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 816 00000100:00100000:3.0:1736366388.944452:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041023552:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366388.944453:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041023680:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366388.944476:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1062 00000100:00100000:1.0:1736366388.944485:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd78980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041023616:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366388.944504:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366388.944521:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041023552:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 70us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366388.944524:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041023680:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 71us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366388.944533:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 816 00000100:00100000:3.0:1736366388.944538:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 269 00000100:00100000:1.0:1736366388.944548:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd78980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041023616:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 63us (195us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366388.944559:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1062 00000100:00080000:0.0:1736366389.167338:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366389.167344:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366389.167348:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366389.167354:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8732 00000100:00080000:0.0:1736366389.167358:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366389.167364:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366389.167383:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cd7f200 x1820703013054912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366389.167409:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366389.167412:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366389.167414:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366389.167417:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8732 00000100:00080000:0.0:1736366389.167418:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366389.167421:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366389.167429:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cd784c0 x1820703013055040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366389.167431:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013054848:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366389.167447:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013054976:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366389.167449:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366389.167452:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366389.167453:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366389.167454:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013054912:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366389.167456:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8732 00000100:00080000:0.0:1736366389.167457:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366389.167460:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366389.167486:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cd797c0 x1820703013055168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366389.167509:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366389.167512:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366389.167513:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366389.167518:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8732 00000100:00100000:3.0:1736366389.167518:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366389.167519:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1736366389.167520:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366389.167522:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366389.167530:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880074519c80 x1820703013055360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366389.167544:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013055104:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366389.167549:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007451af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013055296:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366389.167572:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013055232:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366389.167573:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054976 00000100:00100000:1.0:1736366389.167580:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366389.167580:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366389.167607:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366389.167608:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055104 00000100:00100000:3.0:1736366389.167614:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054848 00000100:00100000:1.0:1736366389.167622:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366389.167623:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:0.0:1736366389.167630:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b138980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013054976:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366389.167640:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd784c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013055040:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366389.167643:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1736366389.167645:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055296 00000100:00100000:3.0:1736366389.167648:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013054848:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366389.167668:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366389.167679:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055232 00000100:00100000:3.0:1736366389.167689:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013054848:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366389.167691:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b138980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013054976:12345-0@lo:400:kworker/u8:0.0 Request processed in 61us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366389.167694:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd797c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013055168:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366389.167697:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1736366389.167698:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:2.0:1736366389.167699:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7301 00000100:00100000:2.0:1736366389.167706:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013055296:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366389.167716:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013054912 00000100:00100000:0.0:1736366389.167724:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055040 00000100:00100000:3.0:1736366389.167729:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7302 00000100:00100000:0.0:1736366389.167730:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1736366389.167734:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880133142ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013055104:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366389.167734:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013055232:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366389.167741:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366389.167750:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013055296:12345-0@lo:400:kworker/u8:0.0 Request processed in 43us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366389.167759:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7301 00000100:00100000:1.0:1736366389.167761:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880074519c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013055360:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366389.167767:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880133142ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013055104:12345-0@lo:400:kworker/u8:0.0 Request processed in 33us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366389.167768:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013055232:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366389.167773:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:3.0:1736366389.167774:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7302 00000100:00100000:0.0:1736366389.167782:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1736366389.167787:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013054912:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366389.167790:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366389.167799:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055360 00010000:02000000:0.0:1736366389.167811:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366389.167813:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013055232:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366389.167816:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:1.0:1736366389.167821:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1736366389.167822:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013055040:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366389.167826:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013055360:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366389.167835:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366389.167835:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366389.167838:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007451af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013055296:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366389.167841:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013054912:12345-0@lo:38:kworker/u8:0.0 Request processed in 54us (220us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366389.167845:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013054848:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366389.167848:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1736366389.167864:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013055360:12345-0@lo:38:kworker/u8:0.0 Request processed in 37us (77us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366389.167865:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013055040:12345-0@lo:38:kworker/u8:0.0 Request processed in 43us (197us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366389.167874:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1736366389.167885:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013054976:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366389.167889:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055168 00000100:00100000:1.0:1736366389.167891:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1736366389.167904:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77108 00000100:00100000:3.0:1736366389.167908:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013055168:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366389.167917:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366389.167928:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013055104:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366389.167954:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013055168:12345-0@lo:38:kworker/u8:0.0 Request processed in 45us (214us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366389.167961:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366389.167961:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77108 00000100:00080000:1.0:1736366389.167966:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366389.167971:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd797c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013055168:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366389.167983:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366389.167985:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366389.167988:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880074519c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013055360:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366389.167996:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366389.167998:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366389.168000:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013054912:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366389.168006:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366389.168008:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366389.168010:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd784c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013055040:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366389.285408:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366390.287425:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366391.289435:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366391.919430:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013055424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366391.919500:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366391.919573:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055424 00000100:00100000:2.0:1736366391.919627:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5948 00000100:00100000:2.0:1736366391.919633:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013055424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366391.919664:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366391.919715:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013055424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366391.919741:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5948 00000100:00100000:0.0:1736366391.919742:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013055424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366391.935405:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013055488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366391.935445:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366391.935504:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055488 00000100:00100000:2.0:1736366391.935533:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5949 00000100:00100000:2.0:1736366391.935538:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013055488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366391.935560:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366391.935611:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013055488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366391.935618:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5949 00000100:00100000:0.0:1736366391.935646:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013055488:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366392.291427:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366393.293425:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366393.952149:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366393.952221:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366393.952262:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366393.952294:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023872 00000100:00100000:2.0:1736366393.952294:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023744 00000100:00100000:2.0:1736366393.952353:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 271 00000100:00100000:1.0:1736366393.952356:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023808 00000100:00100000:2.0:1736366393.952363:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041023744:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366393.952392:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 819 00000100:00100000:1.0:1736366393.952398:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041023872:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366393.952406:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1066 00000100:00100000:3.0:1736366393.952414:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880074519c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041023808:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366393.952432:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366393.952448:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041023872:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 50us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366393.952448:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041023744:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 84us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366393.952460:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 271 00000100:00100000:1.0:1736366393.952461:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 819 00000100:00100000:3.0:1736366393.952474:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880074519c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041023808:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 60us (212us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366393.952482:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1066 00000100:00080000:0.0:1736366394.175332:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366394.175338:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366394.175342:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366394.175347:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8737 00000100:00080000:0.0:1736366394.175350:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366394.175356:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366394.175377:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f0dda40 x1820703013055616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366394.175411:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366394.175414:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366394.175427:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366394.175430:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8737 00000100:00080000:0.0:1736366394.175432:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00100000:3.0:1736366394.175434:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007451af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013055552:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366394.175435:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366394.175447:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f0d97c0 x1820703013055744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366394.175449:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013055616:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366394.175460:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0de3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013055680:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366394.175462:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366394.175465:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366394.175466:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366394.175469:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8737 00000100:00080000:0.0:1736366394.175471:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366394.175473:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366394.175480:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f0d8e40 x1820703013055872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366394.175491:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366394.175497:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366394.175500:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366394.175501:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366394.175504:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8737 00000100:00080000:0.0:1736366394.175505:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00100000:1.0:1736366394.175507:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366394.175508:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366394.175515:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f0daf80 x1820703013056064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366394.175521:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055552 00000100:00100000:3.0:1736366394.175521:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0db440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013056000:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366394.175539:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0dbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013055808:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366394.175545:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013055744:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366394.175546:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366394.175557:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1736366394.175560:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736366394.175564:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013055552:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366394.175566:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0daac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013055936:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366394.175580:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366394.175583:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366394.175618:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366394.175622:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056000 00000100:00100000:2.0:1736366394.175635:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013055552:12345-0@lo:400:kworker/u8:0.0 Request processed in 70us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366394.175636:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013055872:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366394.175643:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055616 00000100:00100000:2.0:1736366394.175645:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1736366394.175647:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055936 00000100:00100000:3.0:1736366394.175663:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7303 00000100:00100000:1.0:1736366394.175668:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366394.175668:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd784c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013056000:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366394.175673:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055808 00000100:00100000:1.0:1736366394.175686:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0daf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013056064:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366394.175687:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7304 00000100:00100000:0.0:1736366394.175689:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055744 00000100:00100000:2.0:1736366394.175693:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013055936:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366394.175699:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:3.0:1736366394.175703:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd784c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013056000:12345-0@lo:400:kworker/u8:0.0 Request processed in 36us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366394.175705:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ed0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013055808:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366394.175710:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7303 00000100:00100000:1.0:1736366394.175714:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366394.175734:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013055936:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366394.175735:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056064 00000100:00100000:1.0:1736366394.175743:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055872 00000100:00100000:0.0:1736366394.175746:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ed0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013055808:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366394.175753:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:2.0:1736366394.175754:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7304 00000100:00100000:3.0:1736366394.175761:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1736366394.175765:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013055616:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366394.175769:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77109 00000100:00100000:0.0:1736366394.175774:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1736366394.175775:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013055872:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366394.175776:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366394.175777:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ab7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013055744:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366394.175787:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736366394.175788:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366394.175789:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366394.175815:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013055616:12345-0@lo:38:kworker/u8:0.0 Request processed in 49us (311us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366394.175817:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013055744:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (201us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366394.175821:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:0.0:1736366394.175825:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1736366394.175825:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ab6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013055872:12345-0@lo:38:kworker/u8:0.0 Request processed in 48us (157us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366394.175834:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77109 00000100:00100000:3.0:1736366394.175836:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013055680 00000100:00100000:0.0:1736366394.175837:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1736366394.175840:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b684c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013056064:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366394.175846:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366394.175848:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:3.0:1736366394.175851:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013055680:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366394.175860:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b684c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013056064:12345-0@lo:38:kworker/u8:0.0 Request processed in 19us (148us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366394.175866:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00080000:1.0:1736366394.175878:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366394.175879:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013055680:12345-0@lo:400:kworker/u8:0.0 Request processed in 26us (92us total) trans 0 rc 0/0 00000100:00080000:1.0:1736366394.175882:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366394.175884:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:1.0:1736366394.175887:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0d97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013055744:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366394.175895:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0dbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013055808:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366394.175912:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366394.175912:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0de3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013055680:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366394.175912:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0daac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013055936:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366394.175915:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366394.175919:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0d8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013055872:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366394.175921:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0db440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013056000:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366394.175930:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007451af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013055552:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366394.175931:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366394.175934:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366394.175938:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0daf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013056064:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366394.175949:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366394.175952:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366394.175956:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013055616:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366394.295414:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366395.297412:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366396.299414:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366396.927471:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ee880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013056128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366396.927554:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366396.927629:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056128 00000100:00100000:0.0:1736366396.927681:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5950 00000100:00100000:0.0:1736366396.927688:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a3900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013056128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366396.927720:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366396.927771:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a3900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013056128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366396.927797:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5950 00000100:00100000:2.0:1736366396.927799:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ee880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013056128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366396.943412:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372eb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013056192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366396.943466:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366396.943530:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056192 00000100:00100000:0.0:1736366396.943568:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5951 00000100:00100000:0.0:1736366396.943573:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013056192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366396.943595:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366396.943643:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013056192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366396.943650:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5951 00000100:00100000:1.0:1736366396.943691:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372eb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013056192:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366397.301416:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366398.303441:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366398.960128:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366398.960200:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366398.960242:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366398.960263:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041023936 00000100:00100000:1.0:1736366398.960268:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024064 00000100:00100000:0.0:1736366398.960270:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024000 00000100:00100000:0.0:1736366398.960311:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 822 00000100:00100000:2.0:1736366398.960316:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 273 00000100:00100000:0.0:1736366398.960320:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372eb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041024064:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366398.960325:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041023936:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366398.960329:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1070 00000100:00100000:1.0:1736366398.960336:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041024000:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366398.960354:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366398.960389:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372eb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041024064:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 71us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366398.960397:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 822 00000100:00100000:2.0:1736366398.960398:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041023936:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 73us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366398.960408:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041024000:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 72us (166us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366398.960410:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 273 00000100:00100000:1.0:1736366398.960418:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1070 00000100:00080000:0.0:1736366399.183326:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366399.183332:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366399.183335:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366399.183340:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8742 00000100:00080000:0.0:1736366399.183344:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366399.183349:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366399.183366:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f0daf80 x1820703013056320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366399.183412:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366399.183416:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366399.183417:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366399.183420:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8742 00000100:00080000:0.0:1736366399.183422:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366399.183425:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366399.183433:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013056256:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366399.183434:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f0d97c0 x1820703013056448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366399.183440:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013056384:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366399.183454:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366399.183457:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366399.183458:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366399.183460:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0daf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013056320:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366399.183461:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8742 00000100:00080000:0.0:1736366399.183463:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366399.183466:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366399.183475:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f0daac0 x1820703013056576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366399.183494:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366399.183497:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366399.183498:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366399.183502:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8742 00000100:00080000:0.0:1736366399.183504:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00100000:2.0:1736366399.183504:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366399.183504:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366399.183506:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366399.183514:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800869c3440 x1820703013056768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366399.183521:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0de3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013056640:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366399.183537:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736366399.183544:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0dbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013056704:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366399.183549:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0db440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013056512:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366399.183575:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366399.183581:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056384 00000100:00100000:0.0:1736366399.183592:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366399.183608:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056640 00000100:00100000:3.0:1736366399.183608:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056512 00000100:00100000:3.0:1736366399.183620:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1736366399.183625:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366399.183625:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd797c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013056384:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366399.183630:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:0.0:1736366399.183636:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013056512:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366399.183643:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013056448:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366399.183644:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7305 00000100:00100000:2.0:1736366399.183651:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013056640:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366399.183675:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013056512:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366399.183677:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366399.183682:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:3.0:1736366399.183684:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd797c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013056384:12345-0@lo:400:kworker/u8:0.0 Request processed in 58us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366399.183691:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:0.0:1736366399.183699:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056320 00000100:00100000:1.0:1736366399.183699:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0daac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013056576:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366399.183702:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013056640:12345-0@lo:400:kworker/u8:0.0 Request processed in 50us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366399.183707:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056448 00000100:00100000:0.0:1736366399.183712:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1736366399.183713:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7305 00000100:00100000:0.0:1736366399.183716:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a05f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013056320:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366399.183719:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:3.0:1736366399.183722:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013056448:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366399.183726:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366399.183727:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1736366399.183731:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366399.183745:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800869c3440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013056768:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366399.183751:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a05f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013056320:12345-0@lo:38:kworker/u8:0.0 Request processed in 35us (128us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366399.183755:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013056448:12345-0@lo:38:kworker/u8:0.0 Request processed in 32us (79us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366399.183758:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:3.0:1736366399.183761:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:1.0:1736366399.183772:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366399.183777:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366399.183783:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056576 00000100:00100000:0.0:1736366399.183790:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0db440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013056512:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366399.183796:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366399.183800:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366399.183804:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77110 00000100:00100000:3.0:1736366399.183804:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0d8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013056384:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366399.183805:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0daf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013056320:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366399.183811:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056256 00000100:00080000:1.0:1736366399.183818:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366399.183820:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a063c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013056576:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366399.183821:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366399.183825:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0d97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013056448:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366399.183826:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056704 00000100:00100000:0.0:1736366399.183829:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1736366399.183833:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013056256:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:2.0:1736366399.183834:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366399.183844:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7306 00000100:00100000:3.0:1736366399.183847:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013056704:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366399.183865:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013056256:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366399.183867:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0de3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013056640:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366399.183871:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1736366399.183878:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a063c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013056576:12345-0@lo:38:kworker/u8:0.0 Request processed in 58us (152us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366399.183878:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013056704:12345-0@lo:400:kworker/u8:0.0 Request processed in 30us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366399.183884:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7306 00000100:00100000:2.0:1736366399.183888:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77110 00000100:00080000:1.0:1736366399.183893:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366399.183896:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366399.183900:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013056256:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366399.183900:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0daac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013056576:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366399.183906:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0dbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013056704:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366399.183916:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056768 00000100:00100000:2.0:1736366399.183936:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1736366399.183942:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a076c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013056768:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366399.183986:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366399.184042:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a076c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013056768:12345-0@lo:38:kworker/u8:0.0 Request processed in 98us (269us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366399.184053:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00080000:1.0:1736366399.184086:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366399.184091:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366399.184095:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800869c3440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013056768:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366399.305408:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366400.307389:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366401.309418:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366401.935494:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013056832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366401.935566:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366401.935635:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056832 00000100:00100000:0.0:1736366401.935698:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5952 00000100:00100000:0.0:1736366401.935705:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013056832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366401.935737:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366401.935817:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013056832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366401.935826:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5952 00000100:00100000:3.0:1736366401.935865:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013056832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366401.951376:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736366401.951394:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092a00e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013056896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366401.951437:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366401.951521:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056896 00000100:00100000:0.0:1736366401.951580:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5953 00000100:00100000:0.0:1736366401.951585:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013056896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366401.951608:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366401.951650:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013056896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366401.951657:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5953 00000100:00100000:2.0:1736366401.951670:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092a00e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013056896:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366402.311437:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366403.313423:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366403.968152:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366403.968224:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366403.968265:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366403.968288:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024256 00000100:00100000:1.0:1736366403.968344:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024128 00000100:00100000:3.0:1736366403.968363:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024192 00000100:00100000:3.0:1736366403.968390:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 825 00000100:00100000:3.0:1736366403.968397:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041024256:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366403.968398:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1074 00000100:00100000:1.0:1736366403.968401:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 275 00000100:00100000:0.0:1736366403.968405:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041024192:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:1.0:1736366403.968411:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041024128:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:0.0:1736366403.968424:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366403.968474:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041024256:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 78us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366403.968480:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041024128:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 69us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366403.968481:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041024192:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 76us (216us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366403.968482:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 825 00000100:00100000:0.0:1736366403.968489:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1074 00000100:00100000:1.0:1736366403.968491:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 275 00000100:00080000:0.0:1736366404.191318:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366404.191324:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366404.191327:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366404.191332:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8747 00000100:00080000:0.0:1736366404.191335:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366404.191340:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366404.191358:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f0dda40 x1820703013057024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366404.191403:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366404.191406:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366404.191408:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366404.191411:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8747 00000100:00080000:0.0:1736366404.191413:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00100000:1.0:1736366404.191415:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013057024:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366404.191415:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0daac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013056960:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366404.191417:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366404.191426:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f0d97c0 x1820703013057152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366404.191439:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366404.191442:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366404.191443:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366404.191445:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8747 00000100:00080000:0.0:1736366404.191447:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366404.191450:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366404.191458:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f0d8e40 x1820703013057280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366404.191480:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366404.191480:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366404.191481:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366404.191483:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366404.191484:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366404.191487:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8747 00000100:00080000:0.0:1736366404.191489:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366404.191491:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366404.191499:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56bdc0 x1820703013057472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366404.191502:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0daf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013057216:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366404.191516:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013057152:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366404.191516:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013057408:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366404.191523:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0de3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013057088:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366404.191552:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366404.191555:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366404.191556:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0db440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013057344:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366404.191573:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057024 00000100:00100000:0.0:1736366404.191593:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057216 00000100:00100000:1.0:1736366404.191598:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366404.191612:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057408 00000100:00100000:0.0:1736366404.191614:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:0.0:1736366404.191619:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013057216:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366404.191622:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:3.0:1736366404.191628:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a050c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013057024:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366404.191631:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1736366404.191639:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366404.191645:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057344 00000100:00100000:1.0:1736366404.191650:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013057280:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366404.191662:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013057216:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366404.191668:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:2.0:1736366404.191670:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7307 00000100:00100000:3.0:1736366404.191677:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a050c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013057024:12345-0@lo:38:kworker/u8:0.0 Request processed in 48us (200us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366404.191678:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013057408:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366404.191683:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1736366404.191684:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366404.191686:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057152 00000100:00100000:0.0:1736366404.191699:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1736366404.191702:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013057472:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366404.191703:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a02140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013057152:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366404.191712:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366404.191715:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7308 00000100:00100000:3.0:1736366404.191720:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fa07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013057344:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366404.191727:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366404.191734:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a02140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013057152:12345-0@lo:38:kworker/u8:0.0 Request processed in 30us (104us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366404.191740:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1736366404.191746:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013057408:12345-0@lo:400:kworker/u8:0.0 Request processed in 68us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366404.191749:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057472 00000100:00100000:2.0:1736366404.191756:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7307 00000100:00100000:0.0:1736366404.191757:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:3.0:1736366404.191759:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fa07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013057344:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366404.191760:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013057472:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366404.191762:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:02000000:0.0:1736366404.191765:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366404.191765:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7308 00000100:00080000:1.0:1736366404.191766:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366404.191771:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013057024:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366404.191782:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013057472:12345-0@lo:38:kworker/u8:0.0 Request processed in 21us (57us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366404.191788:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:2.0:1736366404.191793:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013056960 00000100:00080000:1.0:1736366404.191801:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366404.191805:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366404.191807:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366404.191809:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0d97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013057152:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366404.191818:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00080000:1.0:1736366404.191821:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366404.191824:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366404.191824:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013056960:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366404.191830:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057088 00000100:00100000:1.0:1736366404.191835:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013057472:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366404.191845:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:0.0:1736366404.191848:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a569300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013057088:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366404.191859:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013056960:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366404.191905:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1736366404.191913:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057280 00000100:00100000:0.0:1736366404.191918:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a569300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013057088:12345-0@lo:400:kworker/u8:0.0 Request processed in 69us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366404.191937:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:1.0:1736366404.191941:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77111 00000100:00100000:1.0:1736366404.191947:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a03900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013057280:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366404.191953:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013057408:0@lo:400:kworker/u8:0.0 00010000:02000000:1.0:1736366404.191960:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366404.191964:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0daac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013056960:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366404.191976:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0de3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013057088:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366404.192001:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a03900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013057280:12345-0@lo:38:kworker/u8:0.0 Request processed in 52us (315us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366404.192010:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77111 00000100:00100000:1.0:1736366404.192042:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0db440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013057344:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366404.192069:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0daf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013057216:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366404.192070:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366404.192074:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366404.192078:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f0d8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013057280:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366404.315381:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366405.317401:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366406.319372:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366406.943432:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd784c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013057536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366406.943502:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366406.943569:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057536 00000100:00100000:2.0:1736366406.943630:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5954 00000100:00100000:2.0:1736366406.943637:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013057536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366406.943669:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366406.943731:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013057536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366406.943739:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5954 00000100:00100000:0.0:1736366406.943765:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd784c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013057536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366406.959382:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736366406.959397:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013057600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366406.959437:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366406.959563:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057600 00000100:00100000:2.0:1736366406.959601:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5955 00000100:00100000:2.0:1736366406.959606:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a01300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013057600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366406.959631:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366406.959679:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a01300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013057600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366406.959704:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5955 00000100:00100000:1.0:1736366406.959736:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013057600:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366407.321397:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366408.323419:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366408.976011:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366408.976060:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366408.976099:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366408.976145:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024448 00000100:00100000:1.0:1736366408.976196:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024384 00000100:00100000:3.0:1736366408.976206:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024320 00000100:00100000:3.0:1736366408.976249:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 277 00000100:00100000:1.0:1736366408.976253:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 828 00000100:00100000:3.0:1736366408.976256:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041024320:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366408.976263:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041024448:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366408.976264:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1078 00000100:00100000:2.0:1736366408.976271:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041024384:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:2.0:1736366408.976291:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366408.976338:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041024320:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 82us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366408.976341:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041024448:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366408.976341:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041024384:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 68us (241us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366408.976346:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 277 00000100:00100000:2.0:1736366408.976353:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1078 00000100:00100000:1.0:1736366408.976361:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 828 00000100:00080000:0.0:1736366409.199357:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366409.199367:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366409.199370:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366409.199377:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8752 00000100:00080000:0.0:1736366409.199381:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366409.199386:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366409.199408:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56b440 x1820703013057728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366409.199437:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366409.199441:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366409.199443:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366409.199447:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8752 00000100:00080000:0.0:1736366409.199450:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366409.199455:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366409.199456:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013057664:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366409.199456:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013057792:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366409.199470:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56bdc0 x1820703013057856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366409.199532:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366409.199533:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366409.199533:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366409.199537:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366409.199539:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366409.199544:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8752 00000100:00080000:0.0:1736366409.199547:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366409.199552:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366409.199570:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88007451c740 x1820703013057984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366409.199597:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013057728:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366409.199609:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366409.199614:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366409.199616:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736366409.199617:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057664 00000100:00080000:0.0:1736366409.199620:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8752 00000100:00080000:0.0:1736366409.199623:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366409.199627:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366409.199632:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366409.199642:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88007451bdc0 x1820703013058176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366409.199651:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013057856:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366409.199653:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057792 00000100:00100000:2.0:1736366409.199654:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1736366409.199661:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013057664:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366409.199673:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007451e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013058048:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366409.199677:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366409.199695:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007451c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013057984:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366409.199704:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057728 00000100:00100000:2.0:1736366409.199707:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013057664:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366409.199715:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366409.199717:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1736366409.199723:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366409.199724:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057856 00000100:00100000:0.0:1736366409.199736:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366409.199742:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007451ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013057920:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366409.199744:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:1.0:1736366409.199746:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007451bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013058176:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366409.199751:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013057792:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366409.199756:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058048 00000100:00100000:0.0:1736366409.199763:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366409.199775:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366409.199783:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7309 00000100:00100000:0.0:1736366409.199830:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057920 00000100:00100000:2.0:1736366409.199831:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800745197c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013058048:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366409.199843:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013057792:12345-0@lo:400:kworker/u8:0.0 Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366409.199851:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058176 00000100:00100000:3.0:1736366409.199851:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:0.0:1736366409.199863:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:0.0:1736366409.199867:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013057920:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366409.199869:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:3.0:1736366409.199872:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a03dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013057728:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366409.199884:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366409.199887:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800745197c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013058048:12345-0@lo:400:kworker/u8:0.0 Request processed in 56us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366409.199895:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013057984 00000100:00100000:2.0:1736366409.199896:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7309 00000100:00100000:3.0:1736366409.199915:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a03dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013057728:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (285us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366409.199922:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1736366409.199923:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77112 00000100:00100000:0.0:1736366409.199928:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013057920:12345-0@lo:400:kworker/u8:0.0 Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366409.199929:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a00e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013057984:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366409.199931:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:3.0:1736366409.199934:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a004c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013057856:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366409.199939:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00010000:02000000:3.0:1736366409.199939:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366409.199941:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013057792:0@lo:400:kworker/u8:0.0 00010000:02000000:1.0:1736366409.199942:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366409.199954:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a004c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013057856:12345-0@lo:38:kworker/u8:0.0 Request processed in 20us (279us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366409.199960:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736366409.199960:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1736366409.199970:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1736366409.199975:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013058176:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366409.199977:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a00e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013057984:12345-0@lo:38:kworker/u8:0.0 Request processed in 48us (253us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366409.199979:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007451d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013058112:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366409.199986:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77112 00010000:02000000:0.0:1736366409.199989:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366409.200011:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366409.200021:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013057664:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366409.200045:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013058176:12345-0@lo:38:kworker/u8:0.0 Request processed in 67us (269us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366409.200047:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058112 00000100:00080000:1.0:1736366409.200049:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366409.200053:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366409.200055:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:1.0:1736366409.200058:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007451bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013058176:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366409.200071:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366409.200074:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366409.200077:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013057728:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366409.200091:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7310 00000100:00100000:2.0:1736366409.200096:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013058112:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366409.200099:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007451ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013057920:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366409.200103:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366409.200106:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366409.200109:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007451e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013058048:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366409.200110:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013057856:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366409.200122:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366409.200125:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366409.200128:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007451c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013057984:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366409.200141:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013058112:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366409.200150:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7310 00000100:00100000:3.0:1736366409.200191:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007451d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013058112:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366409.325393:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366410.327418:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366411.329423:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366411.951409:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007451e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013058240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366411.951478:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366411.951560:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058240 00000100:00100000:2.0:1736366411.951619:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5956 00000100:00100000:2.0:1736366411.951626:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013058240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366411.951658:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366411.951720:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013058240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366411.951728:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5956 00000100:00100000:3.0:1736366411.951791:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007451e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013058240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366411.967405:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736366411.967424:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013058304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366411.967466:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366411.967533:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058304 00000100:00100000:2.0:1736366411.967575:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5957 00000100:00100000:2.0:1736366411.967581:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0daf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013058304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366411.967608:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366411.967662:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0daf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013058304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366411.967673:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5957 00000100:00100000:1.0:1736366411.967715:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013058304:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366412.331406:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366413.333405:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366413.984092:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366413.984137:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366413.984203:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366413.984219:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024512 00000100:00100000:0.0:1736366413.984240:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024640 00000100:00100000:3.0:1736366413.984257:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024576 00000100:00100000:2.0:1736366413.984268:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 279 00000100:00100000:0.0:1736366413.984275:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 831 00000100:00100000:2.0:1736366413.984276:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041024512:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366413.984280:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041024640:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366413.984303:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1082 00000100:00100000:3.0:1736366413.984309:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041024576:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366413.984326:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366413.984358:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041024640:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366413.984367:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 831 00000100:00100000:2.0:1736366413.984367:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041024512:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366413.984368:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041024576:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 58us (165us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366413.984375:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1082 00000100:00100000:2.0:1736366413.984379:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 279 00000100:00080000:2.0:1736366414.207426:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366414.207434:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366414.207438:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366414.207445:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8757 00000100:00080000:2.0:1736366414.207451:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366414.207458:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366414.207463:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736366414.207480:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013058368:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366414.207483:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800797a2600 x1820703013058432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366414.207527:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366414.207549:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366414.207555:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736366414.207556:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013058432:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366414.207557:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366414.207561:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8757 00000100:00080000:2.0:1736366414.207564:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366414.207569:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366414.207573:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013058496:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366414.207583:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800797a5580 x1820703013058560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366414.207606:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366414.207606:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366414.207610:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366414.207612:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366414.207616:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8757 00000100:00080000:2.0:1736366414.207618:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366414.207622:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366414.207625:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013058624:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366414.207649:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058368 00000100:00100000:2.0:1736366414.207650:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800797a1300 x1820703013058688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366414.207656:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013058560:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366414.207658:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366414.207686:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366414.207686:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00080000:2.0:1736366414.207689:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736366414.207692:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013058368:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366414.207693:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366414.207695:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366414.207699:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8757 00000100:00100000:0.0:1736366414.207702:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058432 00000100:00080000:2.0:1736366414.207702:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1736366414.207772:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013058368:12345-0@lo:400:kworker/u8:0.0 Request processed in 80us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366414.207778:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013058688:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366414.207779:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366414.207780:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1736366414.207785:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058624 00000100:00100000:2.0:1736366414.207799:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56f6c0 x1820703013058880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366414.207801:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058560 00000100:00100000:0.0:1736366414.207815:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:1.0:1736366414.207816:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366414.207820:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013058624:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366414.207823:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:3.0:1736366414.207827:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0db440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013058432:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366414.207835:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013058752:0@lo:400:kworker/u8:0.0 00010000:02000000:3.0:1736366414.207838:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366414.207839:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013058880:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366414.207875:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366414.207876:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0db440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013058432:12345-0@lo:38:kworker/u8:0.0 Request processed in 47us (271us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366414.207877:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366414.207878:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013058624:12345-0@lo:400:kworker/u8:0.0 Request processed in 55us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366414.207882:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1736366414.207888:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1736366414.207898:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058880 00000100:00080000:1.0:1736366414.207900:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366414.207904:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366414.207907:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013058432:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366414.207907:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013058368:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366414.207909:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:3.0:1736366414.207912:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0de3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013058560:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366414.207914:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:0.0:1736366414.207920:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013058880:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366414.207928:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:02000000:3.0:1736366414.207928:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736366414.207933:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366414.207936:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013058816:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366414.207946:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058688 00000100:00100000:3.0:1736366414.207965:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0de3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013058560:12345-0@lo:38:kworker/u8:0.0 Request processed in 51us (279us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366414.207975:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366414.207976:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1736366414.207978:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013058880:12345-0@lo:38:kworker/u8:0.0 Request processed in 56us (103us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366414.207985:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77113 00000100:00100000:0.0:1736366414.207988:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1736366414.207991:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0daac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013058688:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366414.208004:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366414.208007:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058752 00000100:00100000:0.0:1736366414.208021:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366414.208026:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058816 00000100:00100000:2.0:1736366414.208039:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7311 00000100:00100000:1.0:1736366414.208042:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0daac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013058688:12345-0@lo:38:kworker/u8:0.0 Request processed in 51us (227us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366414.208045:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013058752:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366414.208051:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77113 00000100:00100000:0.0:1736366414.208054:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058496 00000100:00100000:3.0:1736366414.208062:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7312 00000100:00100000:3.0:1736366414.208068:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013058816:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366414.208072:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:0.0:1736366414.208076:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013058496:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366414.208087:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013058752:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (211us total) trans 0 rc 0/0 00000100:00080000:1.0:1736366414.208094:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366414.208097:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7311 00000100:00080000:1.0:1736366414.208098:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366414.208102:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013058880:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366414.208115:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366414.208118:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013058496:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (98us total) trans 0 rc 0/0 00000100:00080000:1.0:1736366414.208118:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366414.208120:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013058816:12345-0@lo:400:kworker/u8:0.0 Request processed in 49us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366414.208121:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a1300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013058688:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366414.208124:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:3.0:1736366414.208129:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7312 00000100:00080000:1.0:1736366414.208132:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366414.208133:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013058816:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366414.208135:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366414.208138:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013058560:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366414.208145:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013058752:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366414.208152:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013058624:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366414.208207:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013058496:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366414.335396:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366415.337405:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366416.339405:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366416.959454:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd7e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013058944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366416.959525:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366416.959609:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013058944 00000100:00100000:2.0:1736366416.959707:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5958 00000100:00100000:2.0:1736366416.959713:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007451bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013058944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366416.959746:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366416.959809:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007451bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013058944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366416.959818:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5958 00000100:00100000:0.0:1736366416.959852:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd7e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013058944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366416.975472:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013059008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366416.975516:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366416.975580:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059008 00000100:00100000:2.0:1736366416.975619:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5959 00000100:00100000:2.0:1736366416.975624:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013059008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366416.975645:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366416.975711:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013059008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366416.975718:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5959 00000100:00100000:3.0:1736366416.975754:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013059008:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366417.341450:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366418.343409:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366418.992015:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366418.992062:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366418.992098:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366418.992158:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024832 00000100:00100000:3.0:1736366418.992207:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024704 00000100:00100000:1.0:1736366418.992216:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024768 00000100:00100000:2.0:1736366418.992257:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 834 00000100:00100000:1.0:1736366418.992265:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1086 00000100:00100000:2.0:1736366418.992265:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a00e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041024832:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366418.992271:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 281 00000100:00100000:1.0:1736366418.992272:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a03440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041024768:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366418.992277:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041024704:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:1.0:1736366418.992288:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366418.992340:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a00e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041024832:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 75us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366418.992340:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041024704:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 63us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366418.992346:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a03440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041024768:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 74us (248us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366418.992351:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 281 00000100:00100000:2.0:1736366418.992352:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 834 00000100:00100000:1.0:1736366418.992356:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1086 00000100:00080000:2.0:1736366419.215319:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366419.215325:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366419.215328:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366419.215344:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8762 00000100:00080000:2.0:1736366419.215348:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366419.215353:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366419.215372:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172a600 x1820703013059136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366419.215394:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366419.215397:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366419.215399:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366419.215402:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8762 00000100:00080000:2.0:1736366419.215403:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366419.215406:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366419.215415:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d241c80 x1820703013059264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366419.215423:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013059072:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366419.215428:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013059200:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366419.215442:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366419.215446:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366419.215447:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366419.215449:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8762 00000100:00080000:2.0:1736366419.215451:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366419.215453:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366419.215463:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d240000 x1820703013059392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366419.215472:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366419.215482:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366419.215483:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366419.215485:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366419.215486:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366419.215489:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8762 00000100:00080000:2.0:1736366419.215496:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366419.215499:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366419.215500:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d245a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013059520:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366419.215511:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d2450c0 x1820703013059584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366419.215519:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013059136:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366419.215523:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366419.215538:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366419.215549:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d241c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013059264:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366419.215551:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2417c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013059328:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366419.215552:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d244280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013059456:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366419.215566:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366419.215567:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059520 00000100:00100000:0.0:1736366419.215584:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059200 00000100:00100000:2.0:1736366419.215594:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7313 00000100:00100000:1.0:1736366419.215597:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013059392:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366419.215600:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a05f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013059520:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366419.215606:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366419.215610:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059136 00000100:00100000:1.0:1736366419.215618:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366419.215649:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059264 00000100:00100000:0.0:1736366419.215664:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:1.0:1736366419.215665:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2450c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013059584:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366419.215669:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dd0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013059200:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366419.215678:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a05f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013059520:12345-0@lo:400:kworker/u8:0.0 Request processed in 78us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366419.215678:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059456 00000100:00100000:1.0:1736366419.215684:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366419.215685:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7313 00000100:00100000:2.0:1736366419.215699:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7314 00000100:00100000:2.0:1736366419.215703:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd7e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013059456:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366419.215708:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dd0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013059200:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366419.215708:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059392 00000100:00100000:0.0:1736366419.215714:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:3.0:1736366419.215715:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059584 00000100:00100000:1.0:1736366419.215728:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77114 00000100:00100000:2.0:1736366419.215730:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd7e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013059456:12345-0@lo:400:kworker/u8:0.0 Request processed in 26us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366419.215733:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1736366419.215733:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013059392:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366419.215735:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7314 00000100:00100000:0.0:1736366419.215737:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013059136:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366419.215743:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366419.215743:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00010000:02000000:0.0:1736366419.215747:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366419.215748:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013059264:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366419.215759:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366419.215770:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d245a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013059520:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366419.215775:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013059136:12345-0@lo:38:kworker/u8:0.0 Request processed in 37us (237us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366419.215775:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013059392:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (156us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366419.215781:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1736366419.215782:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77114 00000100:00100000:3.0:1736366419.215792:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013059264:12345-0@lo:38:kworker/u8:0.0 Request processed in 44us (226us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366419.215796:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059072 00000100:00100000:3.0:1736366419.215799:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:0.0:1736366419.215804:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1736366419.215807:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013059584:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366419.215808:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366419.215812:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366419.215814:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00010000:02000000:0.0:1736366419.215815:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366419.215815:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013059136:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366419.215818:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013059072:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366419.215823:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366419.215826:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366419.215828:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d241c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013059264:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366419.215836:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366419.215836:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d244280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013059456:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366419.215838:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013059584:12345-0@lo:38:kworker/u8:0.0 Request processed in 30us (153us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366419.215838:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366419.215843:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:2.0:1736366419.215846:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013059072:12345-0@lo:400:kworker/u8:0.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366419.215848:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013059392:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366419.215852:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1736366419.215864:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736366419.215877:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366419.215879:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366419.215880:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013059072:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366419.215881:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2450c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013059584:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366419.215893:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059328 00000100:00100000:1.0:1736366419.215904:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013059200:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366419.215914:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:3.0:1736366419.215918:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a01300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013059328:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366419.215953:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a01300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013059328:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366419.215958:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1736366419.215975:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2417c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013059328:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366419.345426:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366420.347395:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366421.349358:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366421.967499:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd784c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013059648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366421.967552:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366421.967644:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059648 00000100:00100000:2.0:1736366421.967685:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5960 00000100:00100000:2.0:1736366421.967688:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013059648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366421.967711:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366421.967750:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013059648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366421.967755:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5960 00000100:00100000:1.0:1736366421.967777:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cd784c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013059648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366421.983313:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736366421.983323:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d245a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013059712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366421.983346:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366421.983374:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059712 00000100:00100000:2.0:1736366421.983394:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5961 00000100:00100000:2.0:1736366421.983396:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd784c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013059712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366421.983409:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366421.983435:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd784c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013059712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366421.983438:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5961 00000100:00100000:3.0:1736366421.983453:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d245a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013059712:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366422.351362:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366423.353439:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366424.000226:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366424.000273:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366424.000310:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366424.000356:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025024 00000100:00100000:1.0:1736366424.000388:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024896 00000100:00100000:3.0:1736366424.000418:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041024960 00000100:00100000:1.0:1736366424.000430:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 283 00000100:00100000:2.0:1736366424.000430:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 837 00000100:00100000:1.0:1736366424.000437:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041024896:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366424.000439:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a04c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041025024:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366424.000452:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1090 00000100:00100000:3.0:1736366424.000457:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a06d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041024960:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366424.000474:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366424.000507:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041024896:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 70us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366424.000508:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a04c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041025024:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 70us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366424.000515:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 283 00000100:00100000:2.0:1736366424.000516:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 837 00000100:00100000:3.0:1736366424.000527:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a06d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041024960:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 69us (217us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366424.000617:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1090 00000100:00080000:2.0:1736366424.223359:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366424.223366:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366424.223369:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366424.223377:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8767 00000100:00080000:2.0:1736366424.223380:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366424.223387:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366424.223424:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d244c00 x1820703013059840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366424.223466:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366424.223469:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366424.223470:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366424.223473:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8767 00000100:00080000:2.0:1736366424.223475:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00100000:3.0:1736366424.223475:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d246880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013059776:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366424.223479:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366424.223481:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d245a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013059904:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366424.223487:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d2417c0 x1820703013059968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366424.223500:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366424.223503:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366424.223504:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366424.223506:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8767 00000100:00080000:2.0:1736366424.223508:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366424.223511:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366424.223519:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012d240000 x1820703013060096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366424.223540:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366424.223582:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366424.223583:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366424.223586:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d244c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013059840:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366424.223586:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8767 00000100:00080000:2.0:1736366424.223588:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00100000:3.0:1736366424.223590:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366424.223591:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366424.223592:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366424.223604:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800892f50c0 x1820703013060288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366424.223626:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736366424.223630:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d244280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013060224:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366424.223633:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2450c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013060032:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366424.223636:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366424.223661:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366424.223662:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d2417c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013059968:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366424.223663:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366424.223673:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059904 00000100:00100000:3.0:1736366424.223678:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736366424.223682:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366424.223683:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d241c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013060160:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366424.223692:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059840 00000100:00100000:1.0:1736366424.223694:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013060096:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366424.223701:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366424.223712:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060032 00000100:00100000:1.0:1736366424.223714:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366424.223715:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059968 00000100:00100000:2.0:1736366424.223725:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:0.0:1736366424.223730:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:3.0:1736366424.223730:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060224 00000100:00100000:1.0:1736366424.223731:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013060288:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366424.223731:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a004c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013059904:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366424.223736:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a02600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013060032:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366424.223755:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060160 00000100:00100000:1.0:1736366424.223767:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366424.223769:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7315 00000100:00100000:3.0:1736366424.223774:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013060224:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366424.223778:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a02600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013060032:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366424.223785:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:2.0:1736366424.223788:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a004c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013059904:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366424.223794:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:0.0:1736366424.223800:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060288 00000100:00100000:1.0:1736366424.223802:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060096 00000100:00100000:2.0:1736366424.223810:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:3.0:1736366424.223810:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013060224:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366424.223815:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a17297c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013059840:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366424.223816:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:3.0:1736366424.223817:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7315 00000100:00100000:0.0:1736366424.223820:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013059968:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366424.223823:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77115 00000100:00100000:1.0:1736366424.223828:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013060096:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366424.223829:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366424.223830:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7316 00000100:00100000:3.0:1736366424.223833:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869c6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013060160:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:1.0:1736366424.223839:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736366424.223842:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366424.223854:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869c6880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013060160:12345-0@lo:400:kworker/u8:0.0 Request processed in 20us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366424.223859:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7316 00000100:00100000:2.0:1736366424.223861:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a17297c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013059840:12345-0@lo:38:kworker/u8:0.0 Request processed in 46us (226us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366424.223868:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013060096:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (153us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366424.223868:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1736366424.223872:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013059968:12345-0@lo:38:kworker/u8:0.0 Request processed in 52us (190us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366424.223875:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77115 00000100:00100000:3.0:1736366424.223876:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:3.0:1736366424.223880:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013060288:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366424.223881:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00010000:02000000:3.0:1736366424.223890:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736366424.223906:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366424.223909:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013060288:12345-0@lo:38:kworker/u8:0.0 Request processed in 28us (142us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366424.223910:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366424.223914:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d244c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013059840:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366424.223923:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366424.223925:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366424.223925:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1736366424.223926:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2450c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013060032:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366424.223928:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d2417c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013059968:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366424.223936:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d245a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013059904:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366424.223936:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366424.223938:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366424.223940:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013060096:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366424.223950:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013059776 00000100:00080000:1.0:1736366424.223961:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366424.223963:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366424.223965:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013060288:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366424.223972:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1736366424.223976:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013059776:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366424.224001:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013059776:12345-0@lo:400:kworker/u8:0.0 Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366424.224007:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1736366424.224039:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d241c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013060160:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366424.224047:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d244280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013060224:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366424.224054:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d246880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013059776:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366424.355396:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366425.357400:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366426.359409:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366426.975558:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736366426.975581:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a10980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013060352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366426.975647:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366426.975782:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060352 00000100:00100000:2.0:1736366426.975844:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5962 00000100:00100000:2.0:1736366426.975850:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013060352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366426.975883:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366426.975945:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013060352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366426.975953:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5962 00000100:00100000:1.0:1736366426.975987:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a10980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013060352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366426.991402:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013060416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366426.991441:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366426.991579:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060416 00000100:00100000:2.0:1736366426.991625:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5963 00000100:00100000:2.0:1736366426.991630:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a5580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013060416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366426.991652:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366426.991718:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a5580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013060416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366426.991726:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5963 00000100:00100000:1.0:1736366426.991757:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013060416:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366427.361397:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366428.363395:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366429.007991:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366429.008038:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366429.008076:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366429.008125:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025088 00000100:00100000:1.0:1736366429.008191:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025152 00000100:00100000:3.0:1736366429.008191:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025216 00000100:00100000:0.0:1736366429.008230:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 285 00000100:00100000:1.0:1736366429.008233:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 840 00000100:00100000:0.0:1736366429.008241:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041025088:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366429.008241:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d246880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041025216:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366429.008242:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1094 00000100:00100000:3.0:1736366429.008249:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d244280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041025152:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366429.008265:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366429.008308:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041025088:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 70us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366429.008311:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d246880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041025216:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 71us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366429.008316:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 285 00000100:00100000:3.0:1736366429.008316:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d244280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041025152:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 67us (241us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366429.008319:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 840 00000100:00100000:3.0:1736366429.008324:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1094 00000100:00080000:2.0:1736366429.231319:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366429.231325:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366429.231329:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366429.231334:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8772 00000100:00080000:2.0:1736366429.231338:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366429.231343:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366429.231361:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f9cd580 x1820703013060544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366429.231388:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366429.231391:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366429.231392:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366429.231395:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8772 00000100:00080000:2.0:1736366429.231397:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366429.231399:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366429.231408:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f9c8e40 x1820703013060672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366429.231423:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013060480:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366429.231427:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366429.231430:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366429.231431:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366429.231434:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8772 00000100:00080000:2.0:1736366429.231436:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736366429.231438:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366429.231445:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013060608:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366429.231459:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f9cb900 x1820703013060800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366429.231505:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013060544:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366429.231512:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736366429.231513:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366429.231516:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366429.231517:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366429.231520:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8772 00000100:00080000:2.0:1736366429.231522:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366429.231525:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366429.231533:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f9ca140 x1820703013060992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366429.231544:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9c84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013060928:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366429.231548:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366429.231552:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cb440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013060864:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366429.231574:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9ca600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013060736:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366429.231579:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366429.231599:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366429.231615:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060928 00000100:00100000:0.0:1736366429.231616:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060480 00000100:00100000:2.0:1736366429.231629:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060608 00000100:00100000:1.0:1736366429.231636:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9c8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013060672:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366429.231641:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1736366429.231646:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013060480:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366429.231649:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7317 00000100:00100000:2.0:1736366429.231654:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060544 00000100:00100000:1.0:1736366429.231655:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366429.231655:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d241c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013060928:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366429.231667:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060672 00000100:00100000:1.0:1736366429.231673:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013060800:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366429.231680:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013060480:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366429.231680:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:2.0:1736366429.231685:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a13900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013060608:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366429.231687:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1736366429.231693:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366429.231704:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9ca140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013060992:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366429.231712:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d241c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013060928:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366429.231720:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7317 00000100:00100000:1.0:1736366429.231725:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366429.231732:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a13900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013060608:12345-0@lo:400:kworker/u8:0.0 Request processed in 47us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366429.231739:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:0.0:1736366429.231750:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9c84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013060928:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366429.231750:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060800 00000100:00100000:2.0:1736366429.231752:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060992 00000100:00100000:0.0:1736366429.231758:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013060480:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366429.231758:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013060608:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366429.231761:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1736366429.231764:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013060544:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366429.231770:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77116 00010000:02000000:2.0:1736366429.231773:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366429.231775:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013060800:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366429.231785:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366429.231798:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013060544:12345-0@lo:38:kworker/u8:0.0 Request processed in 33us (200us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366429.231801:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1736366429.231808:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1736366429.231809:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013060672:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366429.231813:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086931300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013060992:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366429.231818:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00010000:02000000:0.0:1736366429.231823:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366429.231823:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013060800:12345-0@lo:38:kworker/u8:0.0 Request processed in 47us (129us total) trans 0 rc -19/-19 00010000:02000000:3.0:1736366429.231823:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366429.231830:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77116 00000100:00100000:2.0:1736366429.231850:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366429.231851:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086931300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013060992:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (126us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366429.231853:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366429.231857:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1736366429.231867:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013060672:12345-0@lo:38:kworker/u8:0.0 Request processed in 58us (211us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366429.231871:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060736 00000100:00100000:3.0:1736366429.231877:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:1.0:1736366429.231881:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013060864 00000100:00100000:1.0:1736366429.231899:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7318 00000100:00100000:3.0:1736366429.231902:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1736366429.231903:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086933440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013060864:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366429.231908:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013060736:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366429.231939:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086933440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013060864:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366429.231945:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7318 00000100:00100000:0.0:1736366429.231957:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cb440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013060864:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366429.231968:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366429.231971:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366429.231975:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013060800:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366429.231975:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013060736:12345-0@lo:400:kworker/u8:0.0 Request processed in 66us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366429.231982:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00080000:1.0:1736366429.231983:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366429.231986:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366429.231988:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9ca140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013060992:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366429.231998:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366429.232000:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366429.232002:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013060544:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366429.232005:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9ca600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013060736:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366429.232009:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366429.232010:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366429.232012:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9c8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013060672:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366429.365405:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366430.367403:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366431.369393:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366431.983554:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013061056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366431.983621:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366431.983682:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061056 00000100:00100000:0.0:1736366431.983725:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5964 00000100:00100000:0.0:1736366431.983732:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9ca600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013061056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366431.983762:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366431.983826:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9ca600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013061056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366431.983834:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5964 00000100:00100000:2.0:1736366431.983865:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013061056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366431.999409:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800869317c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013061120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366431.999474:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366431.999531:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061120 00000100:00100000:2.0:1736366431.999578:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5965 00000100:00100000:2.0:1736366431.999583:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013061120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366431.999606:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366431.999649:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013061120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366431.999656:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5965 00000100:00100000:0.0:1736366431.999669:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800869317c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013061120:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366432.371395:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366433.373436:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366434.016067:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366434.016112:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366434.016151:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366434.016213:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025408 00000100:00100000:1.0:1736366434.016231:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025280 00000100:00100000:2.0:1736366434.016268:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025344 00000100:00100000:1.0:1736366434.016274:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 287 00000100:00100000:3.0:1736366434.016290:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 843 00000100:00100000:1.0:1736366434.016292:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041025280:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366434.016299:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1098 00000100:00100000:3.0:1736366434.016299:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d2417c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041025408:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366434.016305:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d245a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041025344:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:2.0:1736366434.016322:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366434.016359:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041025280:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 68us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366434.016364:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d2417c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041025408:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 66us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366434.016367:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 287 00000100:00100000:2.0:1736366434.016370:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d245a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041025344:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 64us (220us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366434.016372:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 843 00000100:00100000:2.0:1736366434.016378:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1098 00000100:00080000:2.0:1736366434.239335:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366434.239341:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366434.239344:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366434.239350:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8777 00000100:00080000:2.0:1736366434.239363:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736366434.239368:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366434.239409:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f9c9c80 x1820703013061248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366434.239446:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366434.239449:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366434.239451:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736366434.239452:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013061184:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366434.239454:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8777 00000100:00080000:2.0:1736366434.239456:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736366434.239459:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366434.239467:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f9c8e40 x1820703013061376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366434.239472:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1736366434.239481:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366434.239484:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366434.239485:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366434.239488:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8777 00000100:00100000:3.0:1736366434.239488:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013061440:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366434.239489:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736366434.239492:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366434.239499:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f9ca140 x1820703013061504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366434.239512:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366434.239520:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366434.239523:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366434.239524:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366434.239527:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8777 00000100:00080000:2.0:1736366434.239528:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:1.0:1736366434.239531:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9c9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013061248:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366434.239538:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366434.239539:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cb440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013061632:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366434.239544:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366434.239549:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f9cf200 x1820703013061696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366434.239562:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366434.239566:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013061312:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366434.239575:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736366434.239578:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366434.239580:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013061568:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366434.239596:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061440 00000100:00100000:0.0:1736366434.239609:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366434.239615:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366434.239617:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9c8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013061376:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366434.239623:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061248 00000100:00100000:0.0:1736366434.239636:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061632 00000100:00100000:2.0:1736366434.239636:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061312 00000100:00100000:1.0:1736366434.239637:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366434.239646:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061376 00000100:00100000:1.0:1736366434.239647:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9ca140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013061504:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366434.239649:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:2.0:1736366434.239654:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a10e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013061440:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366434.239662:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061568 00000100:00100000:3.0:1736366434.239664:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:1.0:1736366434.239665:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366434.239670:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a15580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013061312:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366434.239677:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7319 00000100:00100000:0.0:1736366434.239682:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d244c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013061632:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366434.239682:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013061696:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366434.239717:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366434.239723:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a10e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013061440:12345-0@lo:400:kworker/u8:0.0 Request processed in 69us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366434.239726:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a15580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013061312:12345-0@lo:400:kworker/u8:0.0 Request processed in 56us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366434.239730:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:3.0:1736366434.239734:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1736366434.239740:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d244c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013061632:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366434.239745:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061696 00000100:00100000:0.0:1736366434.239746:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7319 00000100:00100000:3.0:1736366434.239749:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1736366434.239752:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7320 00000100:00100000:3.0:1736366434.239753:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086935580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013061248:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366434.239757:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:1.0:1736366434.239758:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d2450c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013061568:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366434.239761:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086932600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013061376:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366434.239763:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366434.239770:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366434.239773:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:0.0:1736366434.239777:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869317c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013061696:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366434.239787:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366434.239793:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086935580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013061248:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (216us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366434.239801:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d2450c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013061568:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366434.239802:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1736366434.239803:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086932600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013061376:12345-0@lo:38:kworker/u8:0.0 Request processed in 40us (164us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366434.239808:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7320 00000100:00100000:2.0:1736366434.239809:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:0.0:1736366434.239811:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869317c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013061696:12345-0@lo:38:kworker/u8:0.0 Request processed in 33us (93us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366434.239817:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1736366434.239836:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013061440:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366434.239837:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061504 00000100:00100000:0.0:1736366434.239844:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013061568:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366434.239845:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013061312:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366434.239853:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cb440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013061632:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366434.239855:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77117 00000100:00100000:1.0:1736366434.239859:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086935f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013061504:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366434.239868:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366434.239879:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061184 00000100:00100000:1.0:1736366434.239889:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086935f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013061504:12345-0@lo:38:kworker/u8:0.0 Request processed in 29us (224us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366434.239894:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77117 00000100:00100000:0.0:1736366434.239913:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1736366434.239917:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013061184:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366434.239942:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366434.239945:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366434.239946:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013061184:12345-0@lo:400:kworker/u8:0.0 Request processed in 28us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366434.239949:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013061696:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366434.239957:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366434.239959:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366434.239960:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1736366434.239962:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9c9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013061248:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366434.239969:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366434.239970:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366434.239972:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9c8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013061376:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366434.239980:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366434.239982:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366434.239983:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9ca140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013061504:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366434.239994:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013061184:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366434.375437:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366435.377423:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366436.379433:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366436.991540:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736366436.991564:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013061760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366436.991633:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366436.991701:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061760 00000100:00100000:0.0:1736366436.991764:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5966 00000100:00100000:0.0:1736366436.991771:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c84c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013061760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366436.991803:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366436.991866:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c84c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013061760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366436.991874:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5966 00000100:00100000:2.0:1736366436.991900:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013061760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366437.007420:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800892f50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013061824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366437.007461:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366437.007525:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061824 00000100:00100000:0.0:1736366437.007574:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5967 00000100:00100000:0.0:1736366437.007580:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013061824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366437.007602:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366437.007642:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013061824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366437.007649:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5967 00000100:00100000:2.0:1736366437.007661:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800892f50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013061824:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366437.381403:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366438.383407:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366439.023960:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366439.024004:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366439.024040:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366439.024040:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025472 00000100:00100000:0.0:1736366439.024068:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025600 00000100:00100000:1.0:1736366439.024095:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 289 00000100:00100000:0.0:1736366439.024097:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025536 00000100:00100000:1.0:1736366439.024102:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041025472:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366439.024112:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 846 00000100:00100000:0.0:1736366439.024117:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800892f50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041025600:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366439.024129:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1102 00000100:00100000:2.0:1736366439.024138:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041025536:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:2.0:1736366439.024156:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366439.024198:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800892f50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041025600:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 79us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366439.024199:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041025472:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 96us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366439.024206:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 289 00000100:00100000:0.0:1736366439.024220:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 846 00000100:00100000:2.0:1736366439.024255:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041025536:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 117us (214us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366439.024263:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1102 00000100:00080000:2.0:1736366439.247351:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366439.247358:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366439.247361:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366439.247366:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8782 00000100:00080000:2.0:1736366439.247370:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736366439.247375:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366439.247393:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f9c8e40 x1820703013061952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366439.247421:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366439.247424:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366439.247425:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366439.247428:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8782 00000100:00080000:2.0:1736366439.247430:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736366439.247433:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366439.247441:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f9cf200 x1820703013062080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366439.247450:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9ca140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013061888:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366439.247461:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736366439.247462:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9c9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013062016:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366439.247463:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366439.247474:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366439.247477:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8782 00000100:00080000:2.0:1736366439.247479:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366439.247482:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366439.247492:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012f9cb900 x1820703013062208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366439.247508:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366439.247510:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366439.247512:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366439.247514:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9c8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013061952:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366439.247514:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366439.247515:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366439.247518:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8782 00000100:00080000:2.0:1736366439.247520:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736366439.247522:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366439.247532:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712b440 x1820703013062400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366439.247539:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013062336:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366439.247553:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062016 00000100:00100000:2.0:1736366439.247557:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013062272:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366439.247559:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366439.247563:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366439.247577:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061952 00000100:00100000:0.0:1736366439.247591:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:1.0:1736366439.247595:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013062080:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366439.247596:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013062016:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366439.247609:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366439.247609:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:1.0:1736366439.247614:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366439.247624:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d208980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013061952:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366439.247636:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366439.247644:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736366439.247647:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013062208:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366439.247649:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cb440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013062144:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366439.247652:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013062016:12345-0@lo:400:kworker/u8:0.0 Request processed in 55us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366439.247659:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:3.0:1736366439.247673:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d208980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013061952:12345-0@lo:38:kworker/u8:0.0 Request processed in 50us (115us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366439.247674:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062080 00000100:00100000:1.0:1736366439.247675:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366439.247676:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366439.247680:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:0.0:1736366439.247686:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062144 00000100:00100000:1.0:1736366439.247694:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013062400:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366439.247697:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:0.0:1736366439.247702:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013062144:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366439.247702:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:2.0:1736366439.247703:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062336 00000100:00100000:3.0:1736366439.247705:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013062080:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366439.247710:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1736366439.247712:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366439.247727:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062272 00000100:00100000:3.0:1736366439.247728:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013062080:12345-0@lo:38:kworker/u8:0.0 Request processed in 23us (115us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366439.247731:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366439.247732:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013062144:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (57us total) trans 0 rc 0/0 00000100:00080000:1.0:1736366439.247734:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366439.247734:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:1.0:1736366439.247737:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9c8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013061952:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366439.247738:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1736366439.247741:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7321 00000100:00100000:3.0:1736366439.247744:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062400 00000100:00080000:1.0:1736366439.247746:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366439.247746:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a17200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013062336:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366439.247748:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366439.247750:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013062080:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366439.247758:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7322 00000100:00100000:0.0:1736366439.247762:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013062272:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366439.247762:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:3.0:1736366439.247765:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b139c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013062400:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366439.247770:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366439.247784:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a17200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013062336:12345-0@lo:400:kworker/u8:0.0 Request processed in 37us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366439.247787:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013062272:12345-0@lo:400:kworker/u8:0.0 Request processed in 25us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366439.247787:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062208 00000100:00100000:2.0:1736366439.247790:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7321 00000100:00100000:3.0:1736366439.247796:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b139c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013062400:12345-0@lo:38:kworker/u8:0.0 Request processed in 30us (85us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366439.247801:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1736366439.247804:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7322 00000100:00100000:1.0:1736366439.247809:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77118 00000100:00100000:1.0:1736366439.247813:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013062208:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366439.247820:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013061888 00010000:02000000:1.0:1736366439.247824:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366439.247838:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1736366439.247841:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9c9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013062016:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366439.247842:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013061888:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366439.247844:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cb440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013062144:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366439.247850:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013062208:12345-0@lo:38:kworker/u8:0.0 Request processed in 36us (175us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366439.247854:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013062272:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366439.247857:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77118 00000100:00100000:3.0:1736366439.247867:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013061888:12345-0@lo:400:kworker/u8:0.0 Request processed in 24us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366439.247872:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:1.0:1736366439.247877:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366439.247880:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366439.247883:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013062400:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366439.247891:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366439.247892:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366439.247894:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013062208:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366439.247905:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cd580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013062336:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366439.247913:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9ca140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013061888:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366439.385393:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366440.387447:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366441.389456:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366441.999473:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013062464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366441.999550:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366441.999624:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062464 00000100:00100000:2.0:1736366441.999675:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5968 00000100:00100000:2.0:1736366441.999681:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cabdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013062464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366441.999712:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366441.999762:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cabdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013062464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366441.999769:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5968 00000100:00100000:0.0:1736366441.999789:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013062464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366442.015434:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137129c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013062528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366442.015487:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366442.015547:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062528 00000100:00100000:2.0:1736366442.015583:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5969 00000100:00100000:2.0:1736366442.015588:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013062528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366442.015609:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366442.015660:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013062528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366442.015667:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5969 00000100:00100000:1.0:1736366442.015699:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137129c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013062528:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366442.391440:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366443.393425:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366444.031929:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366444.031972:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366444.032008:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366444.032038:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025792 00000100:00100000:3.0:1736366444.032054:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025664 00000100:00100000:0.0:1736366444.032073:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025728 00000100:00100000:1.0:1736366444.032090:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 849 00000100:00100000:1.0:1736366444.032100:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cacc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041025792:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366444.032107:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 291 00000100:00100000:0.0:1736366444.032110:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1106 00000100:00100000:3.0:1736366444.032114:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041025664:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366444.032118:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041025728:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:0.0:1736366444.032138:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366444.032213:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041025664:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 98us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366444.032214:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cacc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041025792:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 116us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366444.032243:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 849 00000100:00100000:3.0:1736366444.032243:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 291 00000100:00100000:0.0:1736366444.032257:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041025728:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 137us (247us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366444.032268:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1106 00000100:00080000:2.0:1736366444.255339:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366444.255346:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366444.255349:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366444.255354:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8787 00000100:00080000:2.0:1736366444.255359:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366444.255364:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366444.255381:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712b900 x1820703013062656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366444.255437:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013062592:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366444.255438:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366444.255443:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366444.255445:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366444.255450:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8787 00000100:00080000:2.0:1736366444.255453:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1736366444.255457:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1736366444.255457:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366444.255473:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801371297c0 x1820703013062784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366444.255475:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013062720:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366444.255483:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013062656:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366444.255491:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366444.255495:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366444.255499:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366444.255501:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366444.255505:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8787 00000100:00080000:2.0:1736366444.255507:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366444.255511:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366444.255522:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366444.255523:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712df00 x1820703013062912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366444.255528:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736366444.255535:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013062848:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366444.255553:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062720 00000100:00080000:2.0:1736366444.255561:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366444.255565:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366444.255567:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366444.255572:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8787 00000100:00100000:1.0:1736366444.255575:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013062976:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366444.255575:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1736366444.255575:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366444.255580:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366444.255587:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062848 00000100:00100000:2.0:1736366444.255594:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880137129c80 x1820703013063104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366444.255600:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366444.255602:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062592 00000100:00100000:0.0:1736366444.255608:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1736366444.255614:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736366444.255615:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9ca140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013062720:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366444.255619:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013063040:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366444.255627:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1736366444.255629:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1736366444.255635:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366444.255635:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013062592:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366444.255643:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a14740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013062848:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366444.255662:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062976 00000100:00100000:0.0:1736366444.255676:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9ca140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013062720:12345-0@lo:400:kworker/u8:0.0 Request processed in 60us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366444.255676:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013062592:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366444.255683:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1736366444.255686:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1736366444.255687:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063040 00000100:00100000:2.0:1736366444.255698:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a14740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013062848:12345-0@lo:400:kworker/u8:0.0 Request processed in 56us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366444.255702:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7323 00000100:00100000:1.0:1736366444.255707:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cd580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013062976:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366444.255707:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:0.0:1736366444.255719:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7324 00000100:00100000:3.0:1736366444.255725:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013062848:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366444.255726:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cb900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013063040:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366444.255746:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cd580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013062976:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366444.255751:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013062592:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366444.255753:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7323 00000100:00100000:0.0:1736366444.255763:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cb900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013063040:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366444.255784:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013062720:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366444.255786:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7324 00000100:00100000:1.0:1736366444.255804:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013063040:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366444.255820:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366444.255825:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013062976:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366444.255876:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013062784:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366444.255898:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062656 00000100:00100000:0.0:1736366444.255911:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366444.255932:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1736366444.255938:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013062656:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366444.255942:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013062912:0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366444.255952:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366444.255965:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062784 00000100:00100000:0.0:1736366444.255973:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366444.255985:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013062656:12345-0@lo:38:kworker/u8:0.0 Request processed in 46us (166us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366444.255994:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1736366444.256000:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1736366444.256004:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137129c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013063104:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366444.256004:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013062784:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366444.256015:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366444.256034:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013062912 00000100:00100000:3.0:1736366444.256045:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013062784:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (135us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366444.256047:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366444.256057:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77119 00000100:00100000:1.0:1736366444.256061:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013062912:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366444.256062:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1736366444.256070:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063104 00010000:02000000:1.0:1736366444.256071:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1736366444.256077:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366444.256080:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366444.256085:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013062656:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366444.256100:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013062912:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (128us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366444.256102:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1736366444.256107:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77119 00000100:00100000:2.0:1736366444.256108:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880135298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013063104:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366444.256110:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366444.256113:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366444.256116:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013062784:0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366444.256120:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1736366444.256129:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366444.256133:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366444.256136:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013062912:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366444.256153:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880135298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013063104:12345-0@lo:38:kworker/u8:0.0 Request processed in 45us (107us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736366444.256157:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366444.256194:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00080000:0.0:1736366444.256195:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366444.256199:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137129c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013063104:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366444.395427:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366445.397374:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366446.399357:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366447.007428:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801352984c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013063168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366447.007494:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366447.007566:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063168 00000100:00100000:0.0:1736366447.007620:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5970 00000100:00100000:0.0:1736366447.007629:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013063168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366447.007680:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366447.007752:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013063168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366447.007761:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5970 00000100:00100000:3.0:1736366447.007795:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801352984c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013063168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366447.023425:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013063232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366447.023467:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366447.023537:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063232 00000100:00100000:0.0:1736366447.023581:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5971 00000100:00100000:0.0:1736366447.023589:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013063232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366447.023617:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366447.023677:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013063232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366447.023688:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5971 00000100:00100000:1.0:1736366447.023711:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013063232:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366447.401423:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366448.403432:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366449.040117:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366449.040228:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366449.040257:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025856 00000100:00100000:0.0:1736366449.040270:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366449.040305:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025984 00000100:00100000:3.0:1736366449.040325:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 293 00000100:00100000:3.0:1736366449.040332:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041025856:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366449.040346:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041025920 00000100:00100000:1.0:1736366449.040359:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 852 00000100:00100000:1.0:1736366449.040368:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880135298980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041025984:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366449.040384:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1110 00000100:00100000:0.0:1736366449.040391:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880135298e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041025920:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366449.040405:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041025856:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 73us (294us total) trans 0 rc 0/0 00010000:02000000:0.0:1736366449.040412:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366449.040413:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 293 00000100:00100000:1.0:1736366449.040419:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880135298980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041025984:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 52us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366449.040426:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 852 00000100:00100000:0.0:1736366449.040455:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880135298e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041025920:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 62us (184us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366449.040465:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1110 00000100:00080000:2.0:1736366449.263316:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366449.263322:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366449.263325:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366449.263330:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8792 00000100:00080000:2.0:1736366449.263334:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366449.263349:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366449.263368:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712b440 x1820703013063360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366449.263404:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366449.263409:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013063296:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366449.263409:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366449.263411:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366449.263415:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8792 00000100:00080000:2.0:1736366449.263418:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1736366449.263422:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013063424:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366449.263423:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366449.263438:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880137129c80 x1820703013063488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366449.263456:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013063360:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366449.263461:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366449.263469:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366449.263474:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366449.263479:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366449.263481:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366449.263485:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8792 00000100:00080000:2.0:1736366449.263487:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366449.263491:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366449.263497:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736366449.263505:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013063552:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366449.263506:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801371297c0 x1820703013063616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366449.263517:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366449.263534:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063296 00000100:00100000:3.0:1736366449.263542:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063424 00000100:00100000:0.0:1736366449.263551:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137129c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013063488:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366449.263552:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366449.263556:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366449.263558:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366449.263561:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00080000:2.0:1736366449.263562:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8792 00000100:00080000:2.0:1736366449.263565:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1736366449.263566:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013063296:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366449.263568:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063360 00000100:00080000:2.0:1736366449.263569:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366449.263580:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1736366449.263585:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013063424:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366449.263593:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712da40 x1820703013063808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366449.263595:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366449.263613:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013063296:12345-0@lo:400:kworker/u8:0.0 Request processed in 47us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366449.263619:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013063616:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366449.263621:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1736366449.263628:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013063424:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366449.263631:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063488 00000100:00100000:3.0:1736366449.263634:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:1.0:1736366449.263649:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366449.263651:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:0.0:1736366449.263653:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366449.263655:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880135299300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013063360:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366449.263658:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063552 00000100:00100000:1.0:1736366449.263664:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013063680:0@lo:400:kworker/u8:0.0 00010000:02000000:3.0:1736366449.263664:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366449.263676:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013063808:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366449.263677:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:2.0:1736366449.263683:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013063552:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366449.263684:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366449.263704:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880135299300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013063360:12345-0@lo:38:kworker/u8:0.0 Request processed in 48us (188us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366449.263708:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366449.263710:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063616 00000100:00100000:3.0:1736366449.263711:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1736366449.263722:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063808 00000100:00100000:1.0:1736366449.263726:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77120 00000100:00100000:1.0:1736366449.263730:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880135299c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013063616:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366449.263732:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366449.263732:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:3.0:1736366449.263735:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352997c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013063488:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366449.263736:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00010000:02000000:1.0:1736366449.263739:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366449.263741:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013063360:0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366449.263742:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366449.263751:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013063552:12345-0@lo:400:kworker/u8:0.0 Request processed in 67us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366449.263760:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:1.0:1736366449.263764:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880135299c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013063616:12345-0@lo:38:kworker/u8:0.0 Request processed in 33us (113us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366449.263764:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352997c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013063488:12345-0@lo:38:kworker/u8:0.0 Request processed in 28us (170us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736366449.263769:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736366449.263770:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77120 00000100:00100000:3.0:1736366449.263770:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00080000:0.0:1736366449.263772:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366449.263776:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137129c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013063488:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366449.263780:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1736366449.263784:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063680 00000100:00100000:2.0:1736366449.263785:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013063808:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366449.263787:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366449.263790:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366449.263793:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013063616:0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366449.263797:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366449.263803:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7325 00000100:00100000:1.0:1736366449.263806:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013063680:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366449.263825:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013063424:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366449.263836:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013063680:12345-0@lo:400:kworker/u8:0.0 Request processed in 28us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366449.263837:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013063808:12345-0@lo:38:kworker/u8:0.0 Request processed in 50us (128us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366449.263838:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736366449.263841:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7325 00000100:00100000:3.0:1736366449.263844:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013063744:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366449.263847:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00080000:0.0:1736366449.263860:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366449.263864:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366449.263866:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013063680:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366449.263868:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013063808:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366449.263870:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366449.263876:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013063552:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366449.263885:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013063296:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366449.263897:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063744 00000100:00100000:1.0:1736366449.263912:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7326 00000100:00100000:1.0:1736366449.263915:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a10980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013063744:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366449.263959:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a10980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013063744:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366449.263973:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7326 00000100:00100000:3.0:1736366449.263997:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013063744:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366449.405385:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366450.407353:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366451.409356:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366452.015454:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013063872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366452.015534:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366452.015610:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063872 00000100:00100000:2.0:1736366452.015673:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5972 00000100:00100000:2.0:1736366452.015682:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013063872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366452.015718:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366452.015784:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013063872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366452.015796:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5972 00000100:00100000:0.0:1736366452.015825:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013063872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366452.031407:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013063936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366452.031454:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366452.031521:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013063936 00000100:00100000:2.0:1736366452.031580:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5973 00000100:00100000:2.0:1736366452.031588:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc304c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013063936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366452.031617:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366452.031679:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc304c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013063936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366452.031690:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5973 00000100:00100000:3.0:1736366452.031719:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013063936:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366452.411392:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366453.413411:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366454.048198:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366454.048255:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366454.048296:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026048 00000100:00100000:0.0:1736366454.048326:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366454.048361:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 295 00000100:00100000:2.0:1736366454.048371:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041026048:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366454.048372:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026176 00000100:00100000:3.0:1736366454.048395:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026112 00000100:00100000:0.0:1736366454.048408:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 855 00000100:00100000:0.0:1736366454.048414:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041026176:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366454.048434:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1114 00000100:00100000:3.0:1736366454.048440:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041026112:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:0.0:1736366454.048451:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041026176:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 37us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366454.048451:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041026048:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 79us (256us total) trans 0 rc 0/0 00010000:02000000:3.0:1736366454.048456:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366454.048463:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 855 00000100:00100000:2.0:1736366454.048463:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 295 00000100:00100000:3.0:1736366454.048498:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041026112:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 57us (173us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366454.048516:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1114 00000100:00080000:2.0:1736366454.271330:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366454.271339:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366454.271343:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366454.271349:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8797 00000100:00080000:2.0:1736366454.271353:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366454.271360:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366454.271384:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712a600 x1820703013064064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366454.271385:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013064000:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366454.271438:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366454.271438:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366454.271444:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366454.271446:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366454.271451:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8797 00000100:00080000:2.0:1736366454.271453:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00100000:3.0:1736366454.271466:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013064128:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366454.271470:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366454.271489:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880137129300 x1820703013064192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366454.271500:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064000 00000100:00100000:3.0:1736366454.271511:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366454.271515:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366454.271517:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013064064:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366454.271520:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366454.271522:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366454.271527:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8797 00000100:00100000:0.0:1736366454.271529:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00080000:2.0:1736366454.271530:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366454.271534:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366454.271534:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736366454.271536:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013064000:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366454.271540:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013064256:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366454.271548:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712b900 x1820703013064320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366454.271560:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366454.271580:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064128 00000100:00100000:0.0:1736366454.271596:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013064000:12345-0@lo:400:kworker/u8:0.0 Request processed in 59us (158us total) trans 0 rc 0/0 00000100:00080000:2.0:1736366454.271597:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366454.271599:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013064192:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366454.271601:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366454.271603:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736366454.271606:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1736366454.271606:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064064 00000100:00080000:2.0:1736366454.271607:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8797 00000100:00080000:2.0:1736366454.271610:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366454.271613:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366454.271618:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366454.271620:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:3.0:1736366454.271624:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc30980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013064128:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366454.271629:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801371297c0 x1820703013064512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366454.271637:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013064320:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366454.271648:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064192 00000100:00100000:3.0:1736366454.271663:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc30980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013064128:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366454.271669:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1736366454.271673:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366454.271675:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1736366454.271676:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013064064:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366454.271681:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cf200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013064192:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366454.271685:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00010000:02000000:0.0:1736366454.271689:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366454.271689:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366454.271693:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013064512:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366454.271711:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366454.271721:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366454.271732:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013064064:12345-0@lo:38:kworker/u8:0.0 Request processed in 56us (172us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366454.271733:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cf200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013064192:12345-0@lo:38:kworker/u8:0.0 Request processed in 52us (114us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366454.271742:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1736366454.271744:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013064128:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366454.271745:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366454.271747:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00080000:1.0:1736366454.271748:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366454.271752:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013064064:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366454.271758:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064256 00000100:00080000:1.0:1736366454.271760:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366454.271762:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064512 00000100:00080000:1.0:1736366454.271763:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366454.271765:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013064192:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366454.271772:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013064384:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366454.271783:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:2.0:1736366454.271787:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1736366454.271788:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc30e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013064256:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366454.271792:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369384c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013064512:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366454.271795:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:2.0:1736366454.271802:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366454.271809:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736366454.271814:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013064448:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366454.271815:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064320 00000100:00100000:3.0:1736366454.271832:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366454.271834:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc30e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013064256:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366454.271834:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369384c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013064512:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (112us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366454.271836:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77121 00000100:00100000:1.0:1736366454.271841:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013064320:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366454.271843:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1736366454.271849:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00010000:02000000:1.0:1736366454.271851:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366454.271853:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064384 00000100:00100000:3.0:1736366454.271872:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064448 00000100:00100000:1.0:1736366454.271878:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013064320:12345-0@lo:38:kworker/u8:0.0 Request processed in 37us (206us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366454.271882:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7327 00000100:00100000:1.0:1736366454.271885:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77121 00000100:00100000:3.0:1736366454.271888:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7328 00000100:00100000:2.0:1736366454.271889:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc31300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013064384:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366454.271892:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013064000:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366454.271892:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc317c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013064448:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366454.271923:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366454.271926:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366454.271927:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc317c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013064448:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366454.271929:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013064256:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366454.271929:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013064512:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366454.271935:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc31300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013064384:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (139us total) trans 0 rc 0/0 00000100:00080000:1.0:1736366454.271937:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366454.271939:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366454.271941:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013064320:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366454.271944:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7327 00000100:00100000:3.0:1736366454.271949:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7328 00000100:00100000:3.0:1736366454.271985:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013064448:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366454.271994:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013064384:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366454.415445:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366455.417379:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366456.419323:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366457.023408:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013529b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013064576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366457.023474:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366457.023553:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064576 00000100:00100000:0.0:1736366457.023613:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5974 00000100:00100000:0.0:1736366457.023622:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137129c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013064576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366457.023659:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366457.023712:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137129c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013064576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366457.023722:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5974 00000100:00100000:2.0:1736366457.023746:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013529b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013064576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366457.039428:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc31c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013064640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366457.039473:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366457.039549:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064640 00000100:00100000:0.0:1736366457.039598:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5975 00000100:00100000:0.0:1736366457.039605:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136938980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013064640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366457.039634:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366457.039696:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136938980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013064640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366457.039706:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5975 00000100:00100000:1.0:1736366457.039732:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc31c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013064640:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366457.421412:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366458.423391:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366459.056129:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366459.056214:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366459.056218:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026240 00000100:00100000:0.0:1736366459.056272:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366459.056272:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 297 00000100:00100000:2.0:1736366459.056280:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041026240:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366459.056316:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026368 00000100:00100000:2.0:1736366459.056344:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041026240:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 64us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366459.056345:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026304 00000100:00100000:0.0:1736366459.056352:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 858 00000100:00100000:2.0:1736366459.056356:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 297 00000100:00100000:0.0:1736366459.056359:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041026368:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366459.056384:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1118 00000100:00100000:3.0:1736366459.056390:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041026304:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:0.0:1736366459.056400:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041026368:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 40us (187us total) trans 0 rc 0/0 00010000:02000000:3.0:1736366459.056405:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366459.056420:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 858 00000100:00100000:3.0:1736366459.056446:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041026304:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 56us (176us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366459.056453:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1118 00000100:00080000:2.0:1736366459.279336:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366459.279344:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366459.279348:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366459.279365:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8802 00000100:00080000:2.0:1736366459.279370:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366459.279377:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366459.279395:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736366459.279401:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712da40 x1820703013064768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366459.279411:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013064704:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366459.279460:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366459.279465:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366459.279470:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366459.279473:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366459.279477:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8802 00000100:00080000:2.0:1736366459.279480:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366459.279484:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366459.279485:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013064832:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366459.279499:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712b900 x1820703013064896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366459.279511:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064704 00000100:00100000:0.0:1736366459.279513:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366459.279528:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366459.279532:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013064768:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366459.279532:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366459.279534:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366459.279538:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8802 00000100:00080000:2.0:1736366459.279541:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736366459.279545:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366459.279548:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1736366459.279553:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013064704:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366459.279560:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712df00 x1820703013065024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366459.279568:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736366459.279574:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366459.279577:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013064960:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366459.279595:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366459.279599:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366459.279601:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366459.279605:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8802 00000100:00100000:1.0:1736366459.279610:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013064896:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366459.279616:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00100000:3.0:1736366459.279618:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013064704:12345-0@lo:400:kworker/u8:0.0 Request processed in 64us (158us total) trans 0 rc 0/0 00000100:00080000:2.0:1736366459.279622:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366459.279625:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1736366459.279627:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366459.279639:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712a600 x1820703013065216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366459.279652:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064832 00000100:00100000:0.0:1736366459.279665:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013065088:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366459.279671:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013065152:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366459.279677:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064768 00000100:00100000:2.0:1736366459.279687:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064960 00000100:00100000:1.0:1736366459.279692:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1736366459.279697:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013064832:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366459.279701:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366459.279720:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1736366459.279725:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013064960:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366459.279733:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013064832:12345-0@lo:400:kworker/u8:0.0 Request processed in 36us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366459.279736:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1736366459.279741:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:2.0:1736366459.279743:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136938e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013064768:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366459.279750:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013064832:0@lo:400:kworker/u8:0.0 00010000:02000000:2.0:1736366459.279756:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366459.279756:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013064960:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366459.279760:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366459.279762:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:0.0:1736366459.279763:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013064704:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366459.279775:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013065024:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366459.279790:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013064896 00000100:00100000:0.0:1736366459.279799:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013064960:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366459.279800:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136938e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013064768:12345-0@lo:38:kworker/u8:0.0 Request processed in 56us (225us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366459.279802:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366459.279802:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1736366459.279805:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136939300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013064896:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366459.279810:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1736366459.279813:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013065216:0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366459.279815:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366459.279834:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065024 00000100:00100000:2.0:1736366459.279835:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065088 00000100:00100000:3.0:1736366459.279842:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136939300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013064896:12345-0@lo:38:kworker/u8:0.0 Request processed in 37us (82us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366459.279846:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366459.279849:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1736366459.279857:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065216 00000100:00100000:0.0:1736366459.279859:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77122 00000100:00100000:2.0:1736366459.279859:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7329 00000100:00100000:0.0:1736366459.279865:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369397c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013065024:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366459.279865:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013065088:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366459.279865:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00080000:1.0:1736366459.279868:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366459.279868:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136939c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013065216:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366459.279870:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00010000:02000000:3.0:1736366459.279874:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366459.279875:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013064768:0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366459.279876:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736366459.279883:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366459.279885:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366459.279887:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013064896:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366459.279900:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136939c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013065216:12345-0@lo:38:kworker/u8:0.0 Request processed in 31us (55us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366459.279906:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00080000:1.0:1736366459.279909:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366459.279911:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366459.279913:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369397c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013065024:12345-0@lo:38:kworker/u8:0.0 Request processed in 47us (111us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366459.279913:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013065088:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366459.279914:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013065024:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366459.279921:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366459.279922:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366459.279923:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77122 00000100:00100000:2.0:1736366459.279923:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7329 00000100:00100000:1.0:1736366459.279925:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013065216:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366459.279927:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366459.279940:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065152 00000100:00100000:0.0:1736366459.279960:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013065088:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366459.280012:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7330 00000100:00100000:2.0:1736366459.280019:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013065152:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366459.280068:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013065152:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366459.280078:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7330 00000100:00100000:3.0:1736366459.280082:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013065152:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366459.425425:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366460.427374:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366461.429379:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366462.031397:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013065280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366462.031467:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366462.031543:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065280 00000100:00100000:2.0:1736366462.031599:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5976 00000100:00100000:2.0:1736366462.031617:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013065280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366462.031649:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366462.031697:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013065280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366462.031707:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5976 00000100:00100000:0.0:1736366462.031728:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013065280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366462.047444:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013693a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013065344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366462.047495:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366462.047579:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065344 00000100:00100000:0.0:1736366462.047626:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5977 00000100:00100000:0.0:1736366462.047633:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013065344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366462.047658:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366462.047702:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013065344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366462.047712:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5977 00000100:00100000:2.0:1736366462.047725:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013693a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013065344:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366462.431393:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366463.433420:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366464.063987:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366464.064026:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366464.064076:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366464.064112:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026560 00000100:00100000:3.0:1736366464.064114:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026432 00000100:00100000:2.0:1736366464.064151:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026496 00000100:00100000:3.0:1736366464.064156:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 299 00000100:00100000:0.0:1736366464.064196:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 861 00000100:00100000:3.0:1736366464.064197:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041026432:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366464.064205:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041026560:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366464.064215:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1122 00000100:00100000:1.0:1736366464.064222:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041026496:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366464.064238:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366464.064253:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041026432:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 58us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366464.064258:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041026560:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 53us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366464.064261:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 299 00000100:00100000:0.0:1736366464.064268:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 861 00000100:00100000:1.0:1736366464.064276:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041026496:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 54us (203us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366464.064283:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1122 00000100:00080000:2.0:1736366464.287331:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366464.287339:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366464.287343:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366464.287349:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8807 00000100:00080000:2.0:1736366464.287355:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736366464.287361:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366464.287382:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013065408:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366464.287383:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712cc00 x1820703013065472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366464.287432:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366464.287434:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366464.287439:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366464.287441:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366464.287446:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8807 00000100:00080000:2.0:1736366464.287449:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00100000:3.0:1736366464.287449:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013065536:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366464.287453:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366464.287468:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712df00 x1820703013065600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366464.287491:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065408 00000100:00100000:3.0:1736366464.287493:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366464.287506:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366464.287511:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736366464.287513:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013065472:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366464.287513:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366464.287517:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8807 00000100:00100000:0.0:1736366464.287519:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00080000:2.0:1736366464.287520:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736366464.287525:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366464.287526:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013065408:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366464.287543:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736366464.287550:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013065664:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366464.287553:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366464.287556:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712da40 x1820703013065728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366464.287588:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366464.287591:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013065600:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366464.287592:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366464.287594:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736366464.287595:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366464.287596:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013065408:12345-0@lo:400:kworker/u8:0.0 Request processed in 67us (162us total) trans 0 rc 0/0 00000100:00080000:2.0:1736366464.287598:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8807 00000100:00080000:2.0:1736366464.287601:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736366464.287605:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366464.287617:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013065792:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366464.287618:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712af80 x1820703013065920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366464.287619:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1736366464.287626:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366464.287638:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366464.287646:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013065728:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366464.287650:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065536 00000100:00100000:3.0:1736366464.287652:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736366464.287656:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013065856:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366464.287659:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065472 00000100:00100000:1.0:1736366464.287665:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366464.287672:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366464.287677:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065664 00000100:00100000:1.0:1736366464.287677:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013065920:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366464.287682:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065600 00000100:00100000:1.0:1736366464.287693:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366464.287694:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:3.0:1736366464.287694:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065792 00000100:00100000:0.0:1736366464.287699:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc32600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013065536:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366464.287699:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1736366464.287704:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc32ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013065664:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366464.287716:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065920 00000100:00100000:3.0:1736366464.287717:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065856 00000100:00100000:1.0:1736366464.287735:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1736366464.287735:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7331 00000100:00100000:1.0:1736366464.287740:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013065472:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366464.287740:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc32f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013065792:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366464.287746:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc32600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013065536:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366464.287746:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc32ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013065664:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (152us total) trans 0 rc 0/0 00010000:02000000:1.0:1736366464.287750:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366464.287755:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1736366464.287770:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:2.0:1736366464.287775:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1736366464.287776:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc32f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013065792:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366464.287782:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013065472:12345-0@lo:38:kworker/u8:0.0 Request processed in 40us (228us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366464.287782:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a593f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013065600:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366464.287783:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7331 00000100:00100000:0.0:1736366464.287786:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1736366464.287790:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1736366464.287791:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013065920:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366464.287795:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7332 00000100:00100000:3.0:1736366464.287798:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc33440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013065856:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:0.0:1736366464.287803:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366464.287804:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736366464.287819:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366464.287820:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc33440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013065856:12345-0@lo:400:kworker/u8:0.0 Request processed in 21us (148us total) trans 0 rc 0/0 00000100:00080000:1.0:1736366464.287822:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366464.287825:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7332 00000100:00100000:1.0:1736366464.287826:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013065472:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366464.287834:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366464.287836:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366464.287838:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013065920:12345-0@lo:38:kworker/u8:0.0 Request processed in 46us (144us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366464.287838:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013065600:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366464.287838:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a593f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013065600:12345-0@lo:38:kworker/u8:0.0 Request processed in 56us (210us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366464.287847:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:0.0:1736366464.287851:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00080000:1.0:1736366464.287857:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366464.287858:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013065856:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366464.287859:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366464.287862:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013065920:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366464.287867:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013065792:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366464.287886:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065728 00000100:00100000:3.0:1736366464.287890:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013065664:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366464.287937:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013065536:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366464.287939:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77123 00000100:00100000:1.0:1736366464.287944:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013065728:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366464.287960:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366464.287991:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013065728:12345-0@lo:38:kworker/u8:0.0 Request processed in 46us (325us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366464.287997:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77123 00000100:00080000:1.0:1736366464.288022:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366464.288025:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366464.288026:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013065408:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366464.288028:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013065728:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366464.435424:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366465.437341:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366466.439348:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366467.039443:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013529df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013065984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366467.039513:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366467.039584:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013065984 00000100:00100000:0.0:1736366467.039642:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5978 00000100:00100000:0.0:1736366467.039650:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc33900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013065984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366467.039690:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366467.039762:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc33900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013065984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366467.039771:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5978 00000100:00100000:3.0:1736366467.039808:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013529df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013065984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366467.055412:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013066048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366467.055457:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366467.055581:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066048 00000100:00100000:0.0:1736366467.055631:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5979 00000100:00100000:0.0:1736366467.055639:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013066048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366467.055685:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366467.055749:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013066048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366467.055757:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5979 00000100:00100000:1.0:1736366467.055786:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013066048:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366467.441395:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366468.443404:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366469.071960:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366469.072007:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366469.072044:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366469.072077:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026752 00000100:00100000:3.0:1736366469.072088:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026688 00000100:00100000:1.0:1736366469.072125:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026624 00000100:00100000:0.0:1736366469.072132:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 864 00000100:00100000:0.0:1736366469.072142:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041026752:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366469.072146:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1126 00000100:00100000:3.0:1736366469.072152:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041026688:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366469.072195:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366469.072205:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 301 00000100:00100000:1.0:1736366469.072211:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041026624:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366469.072254:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041026688:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 101us (209us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366469.072257:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041026752:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 113us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366469.072262:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041026624:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 51us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366469.072262:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1126 00000100:00100000:0.0:1736366469.072270:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 864 00000100:00100000:1.0:1736366469.072270:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 301 00000100:00080000:2.0:1736366469.295319:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366469.295327:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366469.295331:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366469.295338:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8812 00000100:00080000:2.0:1736366469.295343:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736366469.295349:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366469.295374:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712ed40 x1820703013066176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366469.295392:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736366469.295409:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013066112:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366469.295419:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366469.295424:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1736366469.295425:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1736366469.295426:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366469.295430:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8812 00000100:00080000:2.0:1736366469.295432:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736366469.295436:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366469.295443:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013066240:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366469.295450:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712e3c0 x1820703013066304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366469.295464:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366469.295479:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366469.295483:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366469.295485:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366469.295489:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8812 00000100:00100000:3.0:1736366469.295490:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366469.295504:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1736366469.295509:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013066176:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366469.295510:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366469.295522:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013066368:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366469.295529:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066240 00000100:00100000:2.0:1736366469.295529:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712e880 x1820703013066432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366469.295547:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366469.295568:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736366469.295570:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066368 00000100:00080000:2.0:1736366469.295572:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366469.295574:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366469.295578:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00080000:2.0:1736366469.295579:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8812 00000100:00100000:3.0:1736366469.295579:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1736366469.295582:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:1.0:1736366469.295585:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc33dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013066240:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366469.295585:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013066496:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366469.295586:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366469.295594:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:2.0:1736366469.295599:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712da40 x1820703013066624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366469.295601:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc34280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013066368:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366469.295606:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366469.295626:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc33dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013066240:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366469.295632:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066496 00000100:00100000:1.0:1736366469.295633:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:0.0:1736366469.295652:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc34280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013066368:12345-0@lo:400:kworker/u8:0.0 Request processed in 49us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366469.295657:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7333 00000100:00100000:0.0:1736366469.295662:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:3.0:1736366469.295662:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc34740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013066496:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366469.295672:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366469.295687:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066176 00000100:00100000:1.0:1736366469.295692:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013066304:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366469.295698:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc34740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013066496:12345-0@lo:400:kworker/u8:0.0 Request processed in 36us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366469.295712:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366469.295719:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7333 00000100:00100000:0.0:1736366469.295735:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066304 00000100:00100000:1.0:1736366469.295743:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013066432:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366469.295758:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1736366469.295760:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013066496:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366469.295762:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366469.295770:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013066368:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366469.295773:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013066624:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366469.295773:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:0.0:1736366469.295775:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013066176:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366469.295778:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013066304:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366469.295787:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:0.0:1736366469.295788:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366469.295788:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366469.295796:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013066560:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366469.295811:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066624 00000100:00100000:1.0:1736366469.295858:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1736366469.295860:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366469.295864:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013066624:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366469.295871:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013066176:12345-0@lo:38:kworker/u8:0.0 Request processed in 98us (197us total) trans 0 rc -19/-19 00010000:02000000:1.0:1736366469.295878:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366469.295879:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013066304:12345-0@lo:38:kworker/u8:0.0 Request processed in 100us (165us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366469.295882:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1736366469.295885:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013066240:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366469.295887:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1736366469.295907:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066560 00000100:00100000:1.0:1736366469.295908:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013066624:12345-0@lo:38:kworker/u8:0.0 Request processed in 44us (120us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366469.295914:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066112 00000100:00100000:1.0:1736366469.295915:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1736366469.295924:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7334 00000100:00100000:3.0:1736366469.295928:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc34c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013066560:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366469.295932:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066432 00000100:00100000:0.0:1736366469.295943:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1736366469.295950:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013066112:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366469.295953:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77124 00000100:00100000:2.0:1736366469.295958:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013066432:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366469.295958:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc34c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013066560:12345-0@lo:400:kworker/u8:0.0 Request processed in 29us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366469.295964:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7334 00010000:02000000:2.0:1736366469.295969:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366469.295985:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013066560:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366469.295990:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013066112:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366469.295998:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013066432:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (235us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366469.296000:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1736366469.296006:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77124 00000100:00100000:0.0:1736366469.296042:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013066112:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366469.296074:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366469.296078:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366469.296082:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013066432:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366469.296094:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366469.296096:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366469.296099:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013066624:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366469.296111:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366469.296114:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366469.296118:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013066176:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366469.296129:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366469.296132:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366469.296135:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013066304:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366469.445395:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366470.447357:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366471.449358:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366472.047453:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc350c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013066688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366472.047528:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366472.047605:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066688 00000100:00100000:2.0:1736366472.047671:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5980 00000100:00100000:2.0:1736366472.047680:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013066688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366472.047717:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366472.047801:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013066688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366472.047812:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5980 00000100:00100000:0.0:1736366472.047854:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc350c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013066688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366472.063485:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366472.063502:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013066752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366472.063539:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366472.063604:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066752 00000100:00100000:2.0:1736366472.063652:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5981 00000100:00100000:2.0:1736366472.063659:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013066752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366472.063688:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366472.063734:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013066752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366472.063744:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5981 00000100:00100000:0.0:1736366472.063762:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013066752:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366472.451405:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366473.453416:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366474.080029:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366474.080073:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366474.080123:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366474.080187:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026944 00000100:00100000:0.0:1736366474.080189:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026880 00000100:00100000:1.0:1736366474.080196:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041026816 00000100:00100000:0.0:1736366474.080232:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 867 00000100:00100000:1.0:1736366474.080237:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 303 00000100:00100000:0.0:1736366474.080243:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041026944:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366474.080243:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041026816:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366474.080252:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1130 00000100:00100000:2.0:1736366474.080258:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041026880:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:2.0:1736366474.080277:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366474.080312:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041026816:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 69us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366474.080318:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041026944:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 76us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366474.080321:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 303 00000100:00100000:2.0:1736366474.080326:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041026880:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 67us (205us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366474.080330:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 867 00000100:00100000:2.0:1736366474.080336:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1130 00000100:00080000:2.0:1736366474.303355:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366474.303364:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366474.303369:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366474.303377:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8817 00000100:00080000:2.0:1736366474.303397:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366474.303405:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366474.303408:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013066816:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366474.303429:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8801371297c0 x1820703013066880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366474.303479:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366474.303493:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366474.303499:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366474.303501:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366474.303505:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8817 00000100:00080000:2.0:1736366474.303509:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366474.303513:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366474.303521:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013066944:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366474.303529:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712af80 x1820703013067008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366474.303548:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066816 00000100:00080000:2.0:1736366474.303552:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366474.303556:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366474.303558:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366474.303562:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8817 00000100:00080000:2.0:1736366474.303564:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366474.303568:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366474.303570:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366474.303572:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013066880:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366474.303581:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712cc00 x1820703013067136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366474.303590:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1736366474.303596:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1736366474.303597:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013066816:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366474.303602:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013067072:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366474.303615:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366474.303616:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366474.303621:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366474.303623:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736366474.303626:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013067200:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366474.303627:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8817 00000100:00080000:2.0:1736366474.303630:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366474.303643:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366474.303655:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013067008:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366474.303660:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712ed40 x1820703013067328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366474.303661:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013066816:12345-0@lo:400:kworker/u8:0.0 Request processed in 63us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366474.303666:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366474.303671:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1736366474.303674:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366474.303681:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736366474.303685:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013067264:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366474.303698:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066944 00000100:00100000:1.0:1736366474.303705:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013067136:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366474.303720:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366474.303727:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366474.303730:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013066880 00000100:00100000:1.0:1736366474.303771:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013067328:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366474.303772:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067008 00000100:00100000:2.0:1736366474.303785:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1736366474.303789:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366474.303791:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067200 00000100:00100000:0.0:1736366474.303793:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1736366474.303793:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc35580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013066944:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366474.303798:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013066880:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366474.303812:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366474.303815:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067328 00000100:00100000:3.0:1736366474.303819:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067264 00000100:00100000:1.0:1736366474.303833:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1736366474.303834:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7335 00000100:00100000:1.0:1736366474.303838:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013067008:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366474.303839:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc35a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013067200:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366474.303844:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc35580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013066944:12345-0@lo:400:kworker/u8:0.0 Request processed in 52us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366474.303846:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013066880:12345-0@lo:38:kworker/u8:0.0 Request processed in 47us (232us total) trans 0 rc -19/-19 00010000:02000000:1.0:1736366474.303849:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366474.303854:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1736366474.303858:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:0.0:1736366474.303871:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:0.0:1736366474.303876:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013067328:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366474.303877:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013067008:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (202us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366474.303881:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc35a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013067200:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366474.303884:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00010000:02000000:0.0:1736366474.303886:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366474.303887:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7335 00000100:00100000:2.0:1736366474.303900:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067136 00000100:00100000:3.0:1736366474.303900:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7336 00000100:00100000:3.0:1736366474.303904:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc35f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013067264:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366474.303917:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013067328:12345-0@lo:38:kworker/u8:0.0 Request processed in 40us (126us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366474.303919:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366474.303922:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366474.303922:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77125 00000100:00100000:3.0:1736366474.303922:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc35f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013067264:12345-0@lo:400:kworker/u8:0.0 Request processed in 18us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366474.303925:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:1.0:1736366474.303926:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013066880:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366474.303928:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013067136:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366474.303928:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7336 00000100:00080000:1.0:1736366474.303933:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366474.303936:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366474.303938:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013067008:0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366474.303938:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366474.303953:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736366474.303955:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366474.303957:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366474.303959:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013067328:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366474.303967:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013066816:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366474.303973:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366474.303975:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366474.303975:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013067136:12345-0@lo:38:kworker/u8:0.0 Request processed in 47us (247us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366474.303978:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013067136:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366474.303979:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013066944:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366474.303984:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77125 00000100:00100000:0.0:1736366474.303995:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067072 00000100:00100000:3.0:1736366474.304002:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013067264:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366474.304010:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013067200:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366474.304026:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1736366474.304031:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc363c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013067072:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366474.304074:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc363c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013067072:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366474.304082:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013067072:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366474.304083:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00010000:00010000:3.0:1736366474.455396:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366475.457395:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366476.459348:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366477.055453:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880135298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013067392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366477.055524:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366477.055597:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067392 00000100:00100000:2.0:1736366477.055654:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5982 00000100:00100000:2.0:1736366477.055663:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc36880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013067392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366477.055744:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366477.055820:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc36880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013067392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366477.055830:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5982 00000100:00100000:3.0:1736366477.055863:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880135298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013067392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366477.071431:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880135298980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013067456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366477.071485:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366477.071558:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067456 00000100:00100000:2.0:1736366477.071611:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5983 00000100:00100000:2.0:1736366477.071618:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013067456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366477.071646:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366477.071732:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013067456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366477.071740:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5983 00000100:00100000:1.0:1736366477.071751:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880135298980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013067456:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366477.461422:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366478.463432:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366479.087996:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366479.088053:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366479.088090:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027136 00000100:00100000:0.0:1736366479.088107:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366479.088143:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027072 00000100:00100000:0.0:1736366479.088205:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 870 00000100:00100000:0.0:1736366479.088216:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880135298e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041027136:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366479.088218:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1134 00000100:00100000:2.0:1736366479.088225:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880135299300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041027072:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:1.0:1736366479.088236:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027008 00010000:02000000:2.0:1736366479.088242:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366479.088274:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 305 00000100:00100000:1.0:1736366479.088280:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041027008:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366479.088307:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880135298e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041027136:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 91us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366479.088307:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880135299300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041027072:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 80us (199us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366479.088320:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1134 00000100:00100000:1.0:1736366479.088322:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041027008:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 42us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366479.088329:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 870 00000100:00100000:1.0:1736366479.088329:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 305 00000100:00080000:2.0:1736366479.311314:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366479.311322:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366479.311326:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366479.311334:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8822 00000100:00080000:2.0:1736366479.311338:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366479.311345:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366479.311371:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736366479.311371:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712e880 x1820703013067584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366479.311390:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013067520:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366479.311417:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366479.311422:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366479.311424:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366479.311427:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8822 00000100:00100000:3.0:1736366479.311429:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1736366479.311441:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1736366479.311446:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366479.311446:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366479.311455:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013067648:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366479.311464:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880137129300 x1820703013067712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366479.311498:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067520 00000100:00100000:3.0:1736366479.311498:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366479.311508:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013067584:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366479.311510:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366479.311516:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366479.311518:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366479.311533:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8822 00000100:00100000:0.0:1736366479.311534:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00080000:2.0:1736366479.311535:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366479.311540:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366479.311541:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013067520:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366479.311542:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013067776:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366479.311550:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366479.311556:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712c280 x1820703013067840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366479.311580:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067648 00000100:00100000:1.0:1736366479.311589:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013067712:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366479.311594:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366479.311598:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366479.311600:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736366479.311604:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013067520:12345-0@lo:400:kworker/u8:0.0 Request processed in 63us (158us total) trans 0 rc 0/0 00000100:00080000:2.0:1736366479.311605:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8822 00000100:00100000:3.0:1736366479.311605:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067584 00000100:00080000:2.0:1736366479.311607:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1736366479.311608:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366479.311612:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366479.311614:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1736366479.311617:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067712 00000100:00100000:2.0:1736366479.311625:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712a600 x1820703013068032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366479.311626:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013067840:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366479.311630:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:3.0:1736366479.311635:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc36d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013067648:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366479.311647:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366479.311691:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:2.0:1736366479.311696:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1736366479.311697:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013067584:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366479.311702:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013067712:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366479.311710:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366479.311710:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366479.311713:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013068032:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366479.311716:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc36d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013067648:12345-0@lo:400:kworker/u8:0.0 Request processed in 79us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366479.311722:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1736366479.311744:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366479.311754:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013067584:12345-0@lo:38:kworker/u8:0.0 Request processed in 57us (204us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366479.311755:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013067712:12345-0@lo:38:kworker/u8:0.0 Request processed in 53us (147us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366479.311763:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:3.0:1736366479.311764:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067840 00000100:00100000:2.0:1736366479.311767:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1736366479.311780:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77126 00000100:00100000:0.0:1736366479.311782:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068032 00000100:00080000:1.0:1736366479.311782:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366479.311784:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013067840:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366479.311786:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366479.311790:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013067584:0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366479.311795:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736366479.311798:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366479.311801:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366479.311803:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013067712:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366479.311805:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:2.0:1736366479.311805:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013067968:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366479.311810:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013068032:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366479.311819:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366479.311820:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013067840:12345-0@lo:38:kworker/u8:0.0 Request processed in 35us (173us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366479.311826:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77126 00000100:00080000:1.0:1736366479.311841:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366479.311842:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736366479.311844:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366479.311846:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013067840:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366479.311846:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366479.311847:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013068032:12345-0@lo:38:kworker/u8:0.0 Request processed in 36us (102us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366479.311856:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:3.0:1736366479.311857:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1736366479.311859:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366479.311861:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366479.311863:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013067904:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366479.311864:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013068032:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366479.311871:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067776 00000100:00100000:2.0:1736366479.311883:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013067648:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366479.311884:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366479.311890:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:0.0:1736366479.311895:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc37200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013067776:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366479.311905:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067968 00000100:00100000:2.0:1736366479.311921:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013067904 00000100:00100000:3.0:1736366479.311924:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7337 00000100:00100000:3.0:1736366479.311928:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013067968:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366479.311944:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013067520:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366479.311949:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7338 00000100:00100000:0.0:1736366479.311954:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc37200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013067776:12345-0@lo:400:kworker/u8:0.0 Request processed in 59us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366479.311955:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013067904:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366479.311960:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013067968:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366479.311964:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:3.0:1736366479.311979:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7337 00000100:00100000:2.0:1736366479.311993:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013067904:12345-0@lo:400:kworker/u8:0.0 Request processed in 37us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366479.312001:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7338 00000100:00100000:0.0:1736366479.312003:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013067904:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366479.312017:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013067776:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366479.312033:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013067968:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366479.465431:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366480.467382:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366481.469343:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366482.063510:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736366482.063526:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801352997c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013068096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366482.063590:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366482.063687:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068096 00000100:00100000:0.0:1736366482.063754:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5984 00000100:00100000:0.0:1736366482.063763:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013068096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366482.063801:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366482.063853:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013068096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366482.063863:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5984 00000100:00100000:2.0:1736366482.063883:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801352997c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013068096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366482.079466:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736366482.079485:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013529a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013068160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366482.079528:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366482.079585:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068160 00000100:00100000:0.0:1736366482.079644:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5985 00000100:00100000:0.0:1736366482.079653:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013068160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366482.079684:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366482.079744:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013068160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366482.079754:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5985 00000100:00100000:1.0:1736366482.079777:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013529a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013068160:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366482.471398:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366483.473432:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366484.096003:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366484.096058:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366484.096099:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027200 00000100:00100000:0.0:1736366484.096115:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366484.096156:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 307 00000100:00100000:0.0:1736366484.096158:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027328 00000100:00100000:2.0:1736366484.096197:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041027200:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366484.096212:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027264 00000100:00100000:0.0:1736366484.096223:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 873 00000100:00100000:0.0:1736366484.096229:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041027328:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366484.096254:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1138 00000100:00100000:3.0:1736366484.096260:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041027264:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:2.0:1736366484.096267:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041027200:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 72us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366484.096276:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041027328:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 47us (220us total) trans 0 rc 0/0 00010000:02000000:3.0:1736366484.096276:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366484.096280:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 307 00000100:00100000:0.0:1736366484.096285:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 873 00000100:00100000:3.0:1736366484.096317:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041027264:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 57us (204us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366484.096324:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1138 00000100:00080000:2.0:1736366484.319354:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366484.319360:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366484.319372:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366484.319377:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8827 00000100:00080000:2.0:1736366484.319380:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366484.319386:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366484.319404:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712b440 x1820703013068288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366484.319444:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013068224:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366484.319448:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366484.319453:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366484.319454:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366484.319459:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8827 00000100:00080000:2.0:1736366484.319462:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366484.319466:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366484.319480:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712b900 x1820703013068416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366484.319481:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013068352:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366484.319491:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366484.319495:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013068288:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366484.319502:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366484.319506:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366484.319508:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366484.319511:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8827 00000100:00080000:2.0:1736366484.319514:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366484.319518:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366484.319527:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013068480:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366484.319528:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366484.319531:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712af80 x1820703013068544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366484.319566:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736366484.319568:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068224 00000100:00080000:2.0:1736366484.319603:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366484.319605:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366484.319607:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366484.319611:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8827 00000100:00100000:3.0:1736366484.319616:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013068608:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366484.319621:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366484.319627:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366484.319631:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1736366484.319638:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013068224:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366484.319643:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366484.319644:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013068672:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366484.319644:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712aac0 x1820703013068736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366484.319667:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366484.319671:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068352 00000100:00100000:2.0:1736366484.319684:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068608 00000100:00100000:0.0:1736366484.319688:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013068224:12345-0@lo:400:kworker/u8:0.0 Request processed in 50us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366484.319694:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068480 00000100:00100000:1.0:1736366484.319696:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013068224:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366484.319699:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1736366484.319709:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:3.0:1736366484.319714:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc350c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013068352:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366484.319716:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068672 00000100:00100000:1.0:1736366484.319725:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7339 00000100:00100000:1.0:1736366484.319731:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc30980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013068608:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366484.319735:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1736366484.319741:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369384c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013068480:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366484.319750:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc350c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013068352:12345-0@lo:400:kworker/u8:0.0 Request processed in 36us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366484.319755:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7340 00000100:00100000:3.0:1736366484.319757:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:2.0:1736366484.319761:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136938e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013068672:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366484.319770:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc30980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013068608:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366484.319786:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369384c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013068480:12345-0@lo:400:kworker/u8:0.0 Request processed in 44us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366484.319787:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7339 00000100:00100000:0.0:1736366484.319794:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:3.0:1736366484.319795:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013068352:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366484.319805:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136938e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013068672:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366484.319814:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7340 00000100:00100000:1.0:1736366484.319822:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801371297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013068608:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366484.319834:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013068480:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366484.319846:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013068672:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366484.319862:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366484.319905:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013068416:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366484.319924:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068288 00000100:00100000:0.0:1736366484.319938:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366484.319958:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068416 00000100:00100000:0.0:1736366484.319964:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013068544:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366484.319975:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1736366484.319990:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013068288:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366484.319991:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1736366484.319993:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366484.319996:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013068416:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366484.320002:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736366484.320007:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366484.320011:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013068736:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366484.320043:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013068288:12345-0@lo:38:kworker/u8:0.0 Request processed in 55us (181us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366484.320045:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013068416:12345-0@lo:38:kworker/u8:0.0 Request processed in 50us (107us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366484.320048:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366484.320048:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068544 00000100:00100000:3.0:1736366484.320050:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1736366484.320053:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1736366484.320073:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068736 00000100:00100000:2.0:1736366484.320074:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77127 00000100:00100000:2.0:1736366484.320080:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013068544:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366484.320087:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366484.320089:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00080000:0.0:1736366484.320090:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366484.320093:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013068736:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366484.320094:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013068288:0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366484.320094:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736366484.320100:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1736366484.320120:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366484.320123:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366484.320124:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013068736:12345-0@lo:38:kworker/u8:0.0 Request processed in 31us (78us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366484.320127:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013068416:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366484.320130:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:2.0:1736366484.320133:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013068544:12345-0@lo:38:kworker/u8:0.0 Request processed in 52us (141us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736366484.320137:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366484.320140:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366484.320143:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013068544:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366484.320143:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77127 00000100:00080000:0.0:1736366484.320154:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366484.320157:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366484.320160:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013068736:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366484.475424:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366485.477371:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366486.479379:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366487.071406:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366487.071428:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013068800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366487.071489:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366487.071613:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068800 00000100:00100000:2.0:1736366487.071671:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5986 00000100:00100000:2.0:1736366487.071679:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013068800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366487.071718:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366487.071770:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013068800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366487.071795:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5986 00000100:00100000:0.0:1736366487.071803:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013068800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366487.087475:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013529da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013068864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366487.087522:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366487.087613:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068864 00000100:00100000:0.0:1736366487.087664:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5987 00000100:00100000:0.0:1736366487.087671:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013068864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366487.087697:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366487.087741:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013068864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366487.087750:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5987 00000100:00100000:2.0:1736366487.087765:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013529da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013068864:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366487.481408:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366488.483446:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366489.104038:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366489.104098:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366489.104134:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366489.104211:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027392 00000100:00100000:2.0:1736366489.104211:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027456 00000100:00100000:3.0:1736366489.104211:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027520 00000100:00100000:1.0:1736366489.104268:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 309 00000100:00100000:1.0:1736366489.104276:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041027392:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366489.104278:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 876 00000100:00100000:2.0:1736366489.104288:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041027520:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366489.104288:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1142 00000100:00100000:3.0:1736366489.104294:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352984c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041027456:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366489.104312:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366489.104348:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041027392:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 72us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366489.104356:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 309 00000100:00100000:2.0:1736366489.104359:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041027520:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 72us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366489.104363:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352984c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041027456:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 69us (229us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366489.104370:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 876 00000100:00100000:3.0:1736366489.104375:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1142 00000100:00080000:2.0:1736366489.327346:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366489.327352:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366489.327356:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366489.327361:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8832 00000100:00080000:2.0:1736366489.327365:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366489.327370:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366489.327386:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712c280 x1820703013068992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366489.327418:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366489.327423:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366489.327425:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366489.327429:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8832 00000100:00080000:2.0:1736366489.327432:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366489.327437:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366489.327438:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013068928:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366489.327455:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013069056:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366489.327465:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712e880 x1820703013069120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366489.327474:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013068992:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366489.327488:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366489.327535:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366489.327540:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366489.327542:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736366489.327545:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366489.327547:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8832 00000100:00080000:2.0:1736366489.327550:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736366489.327555:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366489.327565:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366489.327566:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068928 00000100:00100000:2.0:1736366489.327571:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712aac0 x1820703013069248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366489.327586:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013069184:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366489.327590:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1736366489.327595:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013068928:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366489.327597:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013069120:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366489.327608:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736366489.327609:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366489.327613:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366489.327614:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366489.327619:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8832 00000100:00080000:2.0:1736366489.327621:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366489.327625:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366489.327629:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736366489.327630:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366489.327632:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013068928:12345-0@lo:400:kworker/u8:0.0 Request processed in 36us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366489.327638:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1736366489.327640:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013712b440 x1820703013069440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366489.327647:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013069248:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366489.327647:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013069312:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366489.327665:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013069376:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366489.327679:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366489.327681:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366489.327681:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069056 00000100:00100000:1.0:1736366489.327704:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366489.327706:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013069440:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366489.327712:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013068992 00000100:00100000:3.0:1736366489.327722:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069312 00000100:00100000:2.0:1736366489.327728:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069184 00000100:00100000:1.0:1736366489.327729:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013068928:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366489.327734:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366489.327742:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069120 00000100:00100000:3.0:1736366489.327747:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069376 00000100:00100000:2.0:1736366489.327752:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069440 00000100:00100000:1.0:1736366489.327760:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:3.0:1736366489.327761:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7341 00000100:00100000:1.0:1736366489.327765:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc30e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013069056:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366489.327766:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc32600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013069312:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366489.327778:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1736366489.327785:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc32ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013069184:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366489.327789:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:2.0:1736366489.327793:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013068992:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366489.327798:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc30e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013069056:12345-0@lo:400:kworker/u8:0.0 Request processed in 33us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366489.327804:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:3.0:1736366489.327804:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc32600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013069312:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (125us total) trans 0 rc 0/0 00010000:02000000:2.0:1736366489.327805:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366489.327810:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7341 00000100:00100000:1.0:1736366489.327818:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:1.0:1736366489.327821:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013069120:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366489.327823:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7342 00000100:00100000:3.0:1736366489.327826:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136939300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013069376:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:1.0:1736366489.327830:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366489.327831:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc32ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013069184:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366489.327841:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:2.0:1736366489.327849:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013068992:12345-0@lo:38:kworker/u8:0.0 Request processed in 55us (285us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366489.327862:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136939300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013069376:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366489.327863:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1736366489.327871:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:0.0:1736366489.327872:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880135298980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013069440:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366489.327872:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7342 00000100:00100000:1.0:1736366489.327873:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013069120:12345-0@lo:38:kworker/u8:0.0 Request processed in 47us (239us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366489.327879:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00010000:02000000:0.0:1736366489.327882:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366489.327890:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069248 00000100:00100000:3.0:1736366489.327905:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77128 00000100:00100000:3.0:1736366489.327909:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352997c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013069248:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366489.327912:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366489.327915:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880135298980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013069440:12345-0@lo:38:kworker/u8:0.0 Request processed in 46us (181us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366489.327915:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137129300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013069056:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366489.327916:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00010000:02000000:3.0:1736366489.327918:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366489.327921:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013069120:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366489.327924:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00080000:2.0:1736366489.327933:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736366489.327935:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013069376:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366489.327936:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366489.327940:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013068992:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366489.327940:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352997c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013069248:12345-0@lo:38:kworker/u8:0.0 Request processed in 30us (262us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366489.327946:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77128 00000100:00080000:2.0:1736366489.327967:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366489.327970:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366489.327974:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013069440:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366489.327985:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013069312:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366489.327986:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366489.327989:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366489.327993:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013069248:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366489.327996:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013069184:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366489.485428:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366490.487392:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366491.489374:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366492.079443:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880135298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013069504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366492.079572:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366492.079675:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069504 00000100:00100000:0.0:1736366492.079729:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5988 00000100:00100000:0.0:1736366492.079735:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136939c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013069504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366492.079767:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366492.079843:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136939c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013069504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366492.079851:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5988 00000100:00100000:1.0:1736366492.079889:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880135298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013069504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366492.095371:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1736366492.095389:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013069568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366492.095441:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366492.095529:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069568 00000100:00100000:0.0:1736366492.095576:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5989 00000100:00100000:0.0:1736366492.095581:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc31c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013069568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366492.095604:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366492.095654:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc31c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013069568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366492.095661:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5989 00000100:00100000:3.0:1736366492.095698:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013069568:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366492.491497:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366493.493414:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366494.112282:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366494.112332:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366494.112376:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366494.112466:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027584 00000100:00100000:3.0:1736366494.112493:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027712 00000100:00100000:1.0:1736366494.112501:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027648 00000100:00100000:1.0:1736366494.112547:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 879 00000100:00100000:2.0:1736366494.112547:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 311 00000100:00100000:3.0:1736366494.112556:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1146 00000100:00100000:1.0:1736366494.112557:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880135298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041027712:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366494.112557:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041027584:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366494.112563:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041027648:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366494.112582:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366494.112638:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880135298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041027712:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 81us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366494.112638:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041027584:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 81us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366494.112638:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041027648:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 74us (262us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366494.112646:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1146 00000100:00100000:2.0:1736366494.112649:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 311 00000100:00100000:1.0:1736366494.112661:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 879 00000100:00080000:0.0:1736366494.335481:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366494.335488:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366494.335491:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366494.335498:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8837 00000100:00080000:0.0:1736366494.335503:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366494.335510:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366494.335530:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad4280 x1820703013069696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366494.335541:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736366494.335562:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013069632:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366494.335567:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366494.335570:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366494.335571:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366494.335575:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8837 00000100:00080000:0.0:1736366494.335577:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366494.335594:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366494.335596:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013069760:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366494.335597:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013069696:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366494.335606:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad04c0 x1820703013069824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366494.335622:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366494.335625:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366494.335626:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366494.335628:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8837 00000100:00080000:0.0:1736366494.335630:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366494.335633:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366494.335641:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad2140 x1820703013069952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366494.335642:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366494.335648:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366494.335662:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1736366494.335663:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366494.335666:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366494.335667:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366494.335670:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8837 00000100:00080000:0.0:1736366494.335671:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366494.335674:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366494.335674:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013070080:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366494.335682:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad2ac0 x1820703013070144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366494.335686:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013069888:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366494.335692:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013069824:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366494.335699:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366494.335731:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070080 00000100:00100000:1.0:1736366494.335732:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366494.335732:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013070016:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366494.335744:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069696 00000100:00100000:3.0:1736366494.335755:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366494.335765:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070016 00000100:00100000:2.0:1736366494.335773:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069888 00000100:00100000:1.0:1736366494.335780:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7343 00000100:00100000:1.0:1736366494.335789:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013070080:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366494.335793:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7344 00000100:00100000:0.0:1736366494.335798:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d208e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013070016:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366494.335800:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1736366494.335806:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013069888:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366494.335808:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366494.335833:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069760 00000100:00100000:0.0:1736366494.335855:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d208e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013070016:12345-0@lo:400:kworker/u8:0.0 Request processed in 55us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366494.335857:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013070080:12345-0@lo:400:kworker/u8:0.0 Request processed in 68us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366494.335858:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1736366494.335859:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013069888:12345-0@lo:400:kworker/u8:0.0 Request processed in 52us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366494.335862:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7344 00000100:00100000:3.0:1736366494.335863:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013069760:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366494.335868:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:1.0:1736366494.335882:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7343 00000100:00100000:2.0:1736366494.335890:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1736366494.335895:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013069696:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366494.335898:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013069760:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366494.335904:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069632 00000100:00100000:3.0:1736366494.335905:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00010000:02000000:2.0:1736366494.335911:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366494.335923:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1736366494.335927:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013069632:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366494.335937:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013069760:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366494.335938:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013069888:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366494.335946:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013069696:12345-0@lo:38:kworker/u8:0.0 Request processed in 50us (299us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366494.335954:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:3.0:1736366494.335959:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013070080:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366494.335960:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013069632:12345-0@lo:400:kworker/u8:0.0 Request processed in 33us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366494.335966:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1736366494.335971:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013069632:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366494.335981:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366494.335988:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013070016:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366494.335998:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013069952:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366494.336035:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366494.336078:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366494.336082:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366494.336087:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013069696:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366494.336098:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069952 00000100:00100000:2.0:1736366494.336109:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013070144:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366494.336139:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77129 00000100:00100000:2.0:1736366494.336140:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366494.336145:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880080b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013069952:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366494.336158:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366494.336209:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013069824 00000100:00100000:2.0:1736366494.336233:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070144 00000100:00100000:3.0:1736366494.336242:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:3.0:1736366494.336249:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013069824:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366494.336258:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880080b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013069952:12345-0@lo:38:kworker/u8:0.0 Request processed in 111us (222us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366494.336258:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1736366494.336264:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013070144:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366494.336264:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366494.336268:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77129 00010000:02000000:2.0:1736366494.336283:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366494.336310:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013069824:12345-0@lo:38:kworker/u8:0.0 Request processed in 61us (329us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366494.336317:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1736366494.336320:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013070144:12345-0@lo:38:kworker/u8:0.0 Request processed in 56us (180us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366494.336329:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00080000:2.0:1736366494.336359:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366494.336363:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366494.336367:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013070144:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366494.336378:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366494.336381:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366494.336384:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013069824:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366494.336394:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366494.336396:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366494.336400:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013069952:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366494.495385:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366495.497432:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366496.499364:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366497.087458:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013070208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366497.087529:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366497.087599:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070208 00000100:00100000:0.0:1736366497.087663:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5990 00000100:00100000:0.0:1736366497.087669:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013070208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366497.087703:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366497.087763:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013070208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366497.087771:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5990 00000100:00100000:3.0:1736366497.087816:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013070208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366497.103432:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013070272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366497.103474:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366497.103543:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070272 00000100:00100000:2.0:1736366497.103606:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5991 00000100:00100000:2.0:1736366497.103614:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad63c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013070272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366497.103643:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366497.103718:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad63c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013070272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366497.103727:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5991 00000100:00100000:0.0:1736366497.103743:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013070272:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366497.501455:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366498.503479:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366499.120149:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366499.120242:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366499.120249:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027904 00000100:00100000:0.0:1736366499.120303:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366499.120319:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027840 00000100:00100000:2.0:1736366499.120377:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 882 00000100:00100000:2.0:1736366499.120400:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041027904:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366499.120407:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1150 00000100:00100000:1.0:1736366499.120411:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027776 00000100:00100000:0.0:1736366499.120414:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041027840:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:0.0:1736366499.120432:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366499.120452:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 313 00000100:00100000:1.0:1736366499.120458:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041027776:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366499.120496:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041027840:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 82us (195us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366499.120496:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041027904:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 98us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366499.120508:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1150 00000100:00100000:1.0:1736366499.120512:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041027776:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 54us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366499.120520:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 313 00000100:00100000:2.0:1736366499.120523:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 882 00000100:00080000:0.0:1736366499.343311:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366499.343320:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366499.343324:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366499.343353:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8842 00000100:00080000:0.0:1736366499.343359:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366499.343366:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366499.343392:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad3900 x1820703013070400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366499.343400:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013070336:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366499.343430:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736366499.343434:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013070400:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366499.343435:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366499.343437:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366499.343441:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8842 00000100:00080000:0.0:1736366499.343444:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366499.343448:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366499.343461:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad4c00 x1820703013070528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366499.343465:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366499.343481:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366499.343492:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366499.343497:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366499.343499:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366499.343503:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8842 00000100:00080000:0.0:1736366499.343506:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366499.343510:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366499.343524:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad17c0 x1820703013070656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366499.343528:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736366499.343529:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013070528:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366499.343537:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013070464:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366499.343548:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366499.343552:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736366499.343564:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013070656:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366499.343570:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366499.343572:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736366499.343572:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366499.343576:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8842 00000100:00080000:0.0:1736366499.343579:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366499.343585:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366499.343586:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366499.343593:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070336 00000100:00100000:2.0:1736366499.343597:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013070784:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366499.343600:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad2140 x1820703013070848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366499.343616:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070400 00000100:00100000:2.0:1736366499.343630:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366499.343634:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1736366499.343636:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070528 00000100:00100000:0.0:1736366499.343637:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013070720:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366499.343641:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013070336:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366499.343646:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070464 00000100:00100000:2.0:1736366499.343661:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013070592:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366499.343665:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:3.0:1736366499.343671:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013070464:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366499.343673:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366499.343691:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366499.343699:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013070336:12345-0@lo:400:kworker/u8:0.0 Request processed in 58us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366499.343706:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1736366499.343708:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013070464:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366499.343709:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070592 00000100:00100000:2.0:1736366499.343724:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1736366499.343731:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013070400:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366499.343731:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:1.0:1736366499.343739:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070656 00010000:02000000:2.0:1736366499.343748:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366499.343748:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:3.0:1736366499.343752:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013070592:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366499.343753:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1736366499.343756:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77130 00000100:00100000:0.0:1736366499.343760:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013070528:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366499.343760:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013070656:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366499.343770:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1736366499.343770:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366499.343788:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013070400:12345-0@lo:38:kworker/u8:0.0 Request processed in 57us (307us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366499.343788:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013070592:12345-0@lo:400:kworker/u8:0.0 Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366499.343793:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:2.0:1736366499.343798:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:1.0:1736366499.343799:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013070656:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (214us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366499.343806:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013070528:12345-0@lo:38:kworker/u8:0.0 Request processed in 46us (257us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366499.343806:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77130 00000100:00100000:0.0:1736366499.343815:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1736366499.343830:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013070848:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366499.343839:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070784 00000100:00100000:1.0:1736366499.343843:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070720 00000100:00100000:2.0:1736366499.343843:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013070592:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366499.343849:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366499.343869:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7345 00000100:00080000:3.0:1736366499.343869:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366499.343872:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366499.343875:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371297c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013070784:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366499.343875:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013070656:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366499.343877:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013070464:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366499.343878:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7346 00000100:00100000:1.0:1736366499.343882:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad04c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013070720:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366499.343884:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366499.343886:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366499.343888:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013070528:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366499.343891:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013070336:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366499.343896:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366499.343898:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366499.343900:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013070400:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366499.343919:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad04c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013070720:12345-0@lo:400:kworker/u8:0.0 Request processed in 36us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366499.343925:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7346 00000100:00100000:0.0:1736366499.343942:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371297c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013070784:12345-0@lo:400:kworker/u8:0.0 Request processed in 65us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366499.343944:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013070784:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366499.343952:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7345 00000100:00100000:1.0:1736366499.343953:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013070720:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366499.343981:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070848 00000100:00100000:0.0:1736366499.344013:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:0.0:1736366499.344018:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013070848:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366499.344029:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366499.344086:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013070848:12345-0@lo:38:kworker/u8:0.0 Request processed in 66us (236us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366499.344093:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00080000:3.0:1736366499.344123:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366499.344126:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366499.344129:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013070848:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366499.505438:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366500.507508:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366501.509473:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366502.095450:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013070912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366502.095530:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366502.095614:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070912 00000100:00100000:2.0:1736366502.095676:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5992 00000100:00100000:2.0:1736366502.095682:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013070912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366502.095714:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366502.095768:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013070912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366502.095776:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5992 00000100:00100000:0.0:1736366502.095800:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013070912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366502.111413:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736366502.111432:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013070976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366502.111486:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366502.111540:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013070976 00000100:00100000:2.0:1736366502.111586:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5993 00000100:00100000:2.0:1736366502.111591:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369397c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013070976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366502.111613:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366502.111664:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369397c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013070976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366502.111671:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5993 00000100:00100000:1.0:1736366502.111704:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013070976:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366502.511475:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366503.513405:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366504.127960:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366504.128001:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366504.128058:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366504.128094:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041027968 00000100:00100000:1.0:1736366504.128095:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028032 00000100:00100000:3.0:1736366504.128095:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028096 00000100:00100000:0.0:1736366504.128131:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 315 00000100:00100000:0.0:1736366504.128139:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041027968:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366504.128148:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 885 00000100:00100000:1.0:1736366504.128155:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041028096:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366504.128211:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1154 00000100:00100000:3.0:1736366504.128218:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041028032:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366504.128235:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366504.128240:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041027968:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 101us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366504.128248:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 315 00000100:00100000:1.0:1736366504.128283:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041028096:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 124us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366504.128296:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 885 00000100:00100000:3.0:1736366504.128305:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041028032:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 87us (304us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366504.128313:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1154 00000100:00080000:0.0:1736366504.351336:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366504.351343:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366504.351346:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366504.351352:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8847 00000100:00080000:0.0:1736366504.351357:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366504.351363:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366504.351381:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad76c0 x1820703013071104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366504.351392:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736366504.351410:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013071040:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366504.351416:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366504.351419:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366504.351432:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366504.351436:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8847 00000100:00100000:1.0:1736366504.351436:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013071168:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366504.351438:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366504.351441:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366504.351452:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad5f00 x1820703013071232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366504.351467:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366504.351470:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366504.351471:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366504.351473:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8847 00000100:00100000:2.0:1736366504.351473:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366504.351475:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366504.351478:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366504.351486:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad2140 x1820703013071360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366504.351492:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013071104:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366504.351500:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366504.351509:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366504.351512:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366504.351513:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366504.351516:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8847 00000100:00080000:0.0:1736366504.351517:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1736366504.351518:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071040 00000100:00080000:0.0:1736366504.351520:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366504.351526:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad3900 x1820703013071552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366504.351530:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736366504.351536:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013071296:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366504.351540:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366504.351549:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1736366504.351555:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013071040:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366504.351556:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366504.351564:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013071232:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366504.351573:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071168 00000100:00100000:1.0:1736366504.351577:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013071488:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366504.351587:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366504.351592:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013071040:12345-0@lo:400:kworker/u8:0.0 Request processed in 37us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366504.351599:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1736366504.351601:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366504.351606:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013071360:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366504.351612:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071104 00000100:00100000:1.0:1736366504.351614:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736366504.351619:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013071424:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366504.351624:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071296 00000100:00100000:3.0:1736366504.351626:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366504.351629:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071232 00000100:00100000:1.0:1736366504.351635:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366504.351636:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:3.0:1736366504.351637:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013071552:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366504.351641:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013071168:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366504.351653:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366504.351654:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1736366504.351657:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071488 00000100:00100000:2.0:1736366504.351658:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013071296:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366504.351678:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071360 00000100:00100000:1.0:1736366504.351681:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071424 00000100:00100000:1.0:1736366504.351696:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7347 00000100:00100000:0.0:1736366504.351698:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013071168:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366504.351700:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013071488:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366504.351700:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77131 00000100:00100000:3.0:1736366504.351704:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013071360:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366504.351706:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:2.0:1736366504.351714:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013071296:12345-0@lo:400:kworker/u8:0.0 Request processed in 55us (157us total) trans 0 rc 0/0 00010000:02000000:3.0:1736366504.351717:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366504.351720:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:0.0:1736366504.351726:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071552 00000100:00100000:0.0:1736366504.351735:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:1.0:1736366504.351736:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013071488:12345-0@lo:400:kworker/u8:0.0 Request processed in 36us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366504.351739:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013071104:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366504.351748:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00010000:02000000:0.0:1736366504.351749:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366504.351749:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013071360:12345-0@lo:38:kworker/u8:0.0 Request processed in 43us (121us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366504.351752:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013071232:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366504.351756:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77131 00000100:00100000:1.0:1736366504.351757:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7347 00010000:02000000:2.0:1736366504.351762:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366504.351771:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013071104:12345-0@lo:38:kworker/u8:0.0 Request processed in 31us (232us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366504.351773:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7348 00000100:00100000:1.0:1736366504.351777:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013071424:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366504.351777:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1736366504.351782:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:3.0:1736366504.351782:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013071552:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366504.351783:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013071232:12345-0@lo:38:kworker/u8:0.0 Request processed in 30us (196us total) trans 0 rc -19/-19 00010000:02000000:3.0:1736366504.351789:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366504.351790:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1736366504.351805:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013071424:12345-0@lo:400:kworker/u8:0.0 Request processed in 27us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366504.351807:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013071552:12345-0@lo:38:kworker/u8:0.0 Request processed in 26us (155us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366504.351811:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7348 00000100:00100000:3.0:1736366504.351823:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:2.0:1736366504.351824:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013071040:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366504.351837:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad2600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013071424:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366504.351845:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013071488:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366504.351863:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736366504.351868:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013071296:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366504.351868:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366504.351873:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013071360:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366504.351877:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013071168:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366504.351886:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366504.351889:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366504.351893:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013071552:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366504.351905:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366504.351908:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366504.351911:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013071104:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366504.351922:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366504.351925:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366504.351928:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013071232:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366504.515359:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366505.517512:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366506.519456:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366507.103407:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013071616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366507.103468:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366507.103523:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071616 00000100:00100000:0.0:1736366507.103563:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5994 00000100:00100000:0.0:1736366507.103568:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013071616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366507.103593:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366507.103631:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013071616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366507.103636:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5994 00000100:00100000:2.0:1736366507.103650:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013071616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366507.119346:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736366507.119358:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013693a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013071680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366507.119392:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366507.119489:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071680 00000100:00100000:0.0:1736366507.119524:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5995 00000100:00100000:0.0:1736366507.119528:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d209c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013071680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366507.119545:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366507.119584:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d209c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013071680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366507.119589:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5995 00000100:00100000:3.0:1736366507.119615:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013693a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013071680:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366507.521480:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366508.523383:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366509.136104:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366509.136153:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366509.136247:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028288 00000100:00100000:0.0:1736366509.136271:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366509.136309:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028224 00000100:00100000:3.0:1736366509.136315:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028160 00000100:00100000:2.0:1736366509.136338:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 888 00000100:00100000:2.0:1736366509.136345:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041028288:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366509.136369:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 317 00000100:00100000:0.0:1736366509.136374:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1158 00000100:00100000:3.0:1736366509.136378:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041028160:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366509.136381:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041028224:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:0.0:1736366509.136398:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366509.136420:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041028288:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 76us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366509.136422:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041028160:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 45us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366509.136428:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 888 00000100:00100000:3.0:1736366509.136440:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 317 00000100:00100000:0.0:1736366509.136441:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041028224:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 61us (171us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366509.136449:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1158 00000100:00080000:0.0:1736366509.359317:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366509.359323:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366509.359326:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366509.359332:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8852 00000100:00080000:0.0:1736366509.359335:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366509.359340:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366509.359357:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad50c0 x1820703013071808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366509.359377:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013071744:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366509.359384:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366509.359387:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366509.359388:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366509.359392:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8852 00000100:00080000:0.0:1736366509.359393:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366509.359396:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366509.359404:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad5f00 x1820703013071936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366509.359416:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013071872:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366509.359424:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366509.359427:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366509.359436:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366509.359441:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8852 00000100:00100000:3.0:1736366509.359441:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013071808:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366509.359442:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00100000:2.0:1736366509.359444:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366509.359445:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366509.359456:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad3900 x1820703013072064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366509.359460:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366509.359475:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366509.359478:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366509.359479:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736366509.359480:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013072192:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366509.359481:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8852 00000100:00080000:0.0:1736366509.359483:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1736366509.359485:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366509.359486:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366509.359492:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad5580 x1820703013072256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366509.359508:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013071936:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366509.359514:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071872 00000100:00100000:2.0:1736366509.359518:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366509.359525:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366509.359527:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013072128:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366509.359540:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071808 00000100:00100000:3.0:1736366509.359545:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013072064:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366509.359551:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071936 00000100:00100000:0.0:1736366509.359563:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366509.359563:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:3.0:1736366509.359566:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366509.359568:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013071872:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366509.359573:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013071744 00000100:00100000:3.0:1736366509.359589:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013072256:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366509.359596:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366509.359602:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013072000:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366509.359607:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013071872:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366509.359609:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1736366509.359609:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366509.359615:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:2.0:1736366509.359616:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013071744:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366509.359623:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366509.359628:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072256 00000100:00100000:1.0:1736366509.359635:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072000 00000100:00100000:3.0:1736366509.359636:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072064 00000100:00100000:0.0:1736366509.359644:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:0.0:1736366509.359650:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013072000:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366509.359656:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77132 00000100:00100000:1.0:1736366509.359659:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1736366509.359661:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013072064:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366509.359663:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013071744:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (221us total) trans 0 rc 0/0 00010000:02000000:3.0:1736366509.359672:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366509.359673:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013071808:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366509.359673:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1736366509.359682:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013072000:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (59us total) trans 0 rc 0/0 00010000:02000000:1.0:1736366509.359684:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366509.359689:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:3.0:1736366509.359700:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013072064:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (134us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366509.359704:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1736366509.359707:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77132 00000100:00100000:0.0:1736366509.359708:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d2097c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013071936:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366509.359715:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013071808:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (230us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366509.359721:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00010000:02000000:0.0:1736366509.359725:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366509.359729:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013071744:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366509.359734:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1736366509.359737:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d208980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013072256:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366509.359740:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:02000000:1.0:1736366509.359742:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1736366509.359743:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366509.359747:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013072064:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366509.359749:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d2097c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013071936:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (224us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366509.359756:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00080000:3.0:1736366509.359756:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366509.359758:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366509.359759:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d208980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013072256:12345-0@lo:38:kworker/u8:0.0 Request processed in 21us (150us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366509.359760:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013071808:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366509.359764:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00080000:3.0:1736366509.359768:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366509.359779:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366509.359782:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013071936:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366509.359784:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072192 00000100:00100000:0.0:1736366509.359785:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013072000:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366509.359787:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072128 00000100:00080000:3.0:1736366509.359807:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736366509.359808:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7349 00000100:00080000:3.0:1736366509.359809:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366509.359811:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013072192:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366509.359812:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013072256:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366509.359818:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7350 00000100:00100000:2.0:1736366509.359823:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013072128:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366509.359837:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013072192:12345-0@lo:400:kworker/u8:0.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366509.359843:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7349 00000100:00100000:1.0:1736366509.359869:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013071872:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366509.359888:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013072128:12345-0@lo:400:kworker/u8:0.0 Request processed in 62us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366509.359890:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad2140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013072128:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366509.359898:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7350 00000100:00100000:2.0:1736366509.359938:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013072192:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366509.525362:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366510.527407:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366511.529414:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366512.111434:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736366512.111460:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013072320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366512.111529:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366512.111667:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072320 00000100:00100000:0.0:1736366512.111729:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5996 00000100:00100000:0.0:1736366512.111735:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013072320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366512.111768:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366512.111829:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013072320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366512.111837:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5996 00000100:00100000:3.0:1736366512.111878:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013072320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366512.127391:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d20df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013072384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366512.127431:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366512.127549:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072384 00000100:00100000:2.0:1736366512.127599:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5997 00000100:00100000:2.0:1736366512.127605:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad2140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013072384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366512.127628:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366512.127676:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad2140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013072384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366512.127696:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d20df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013072384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366512.127703:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5997 00010000:00010000:1.0:1736366512.531422:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366513.533476:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366514.144139:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366514.144214:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366514.144248:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028352 00000100:00100000:0.0:1736366514.144255:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366514.144283:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028480 00000100:00100000:1.0:1736366514.144288:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028416 00000100:00100000:1.0:1736366514.144323:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 891 00000100:00100000:3.0:1736366514.144323:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 319 00000100:00100000:1.0:1736366514.144333:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041028480:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366514.144333:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041028352:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366514.144340:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1162 00000100:00100000:0.0:1736366514.144346:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041028416:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:0.0:1736366514.144363:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366514.144416:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041028480:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 81us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366514.144416:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041028352:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 84us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366514.144418:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041028416:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 71us (163us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366514.144429:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 891 00000100:00100000:3.0:1736366514.144429:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 319 00000100:00100000:0.0:1736366514.144444:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1162 00000100:00080000:0.0:1736366514.367324:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366514.367330:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366514.367333:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366514.367340:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8857 00000100:00080000:0.0:1736366514.367343:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366514.367347:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366514.367366:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad4c00 x1820703013072512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366514.367368:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013072448:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366514.367400:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366514.367403:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366514.367404:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366514.367407:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8857 00000100:00080000:0.0:1736366514.367409:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366514.367412:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366514.367420:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad5f00 x1820703013072640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366514.367422:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013072576:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366514.367426:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366514.367433:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366514.367435:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366514.367437:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366514.367439:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8857 00000100:00080000:0.0:1736366514.367441:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366514.367444:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366514.367444:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013072512:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366514.367452:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099ad3900 x1820703013072768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366514.367469:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366514.367474:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013072704:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366514.367492:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366514.367495:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366514.367496:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366514.367499:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8857 00000100:00080000:0.0:1736366514.367501:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366514.367504:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366514.367504:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366514.367513:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13b900 x1820703013072960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366514.367517:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013072832:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366514.367527:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072576 00000100:00100000:3.0:1736366514.367531:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013072640:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366514.367539:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072512 00000100:00100000:2.0:1736366514.367540:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366514.367557:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736366514.367561:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1736366514.367562:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013072896:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366514.367562:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366514.367567:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013072576:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366514.367572:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072640 00000100:00100000:2.0:1736366514.367580:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366514.367588:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013072768:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366514.367592:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:1.0:1736366514.367599:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013072512:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366514.367605:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072832 00010000:02000000:1.0:1736366514.367613:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366514.367615:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013072576:12345-0@lo:400:kworker/u8:0.0 Request processed in 49us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366514.367622:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:3.0:1736366514.367623:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366514.367635:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1736366514.367639:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013072640:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366514.367641:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013072960:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366514.367642:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072896 00000100:00100000:1.0:1736366514.367647:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013072512:12345-0@lo:38:kworker/u8:0.0 Request processed in 48us (145us total) trans 0 rc -19/-19 00010000:02000000:0.0:1736366514.367648:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366514.367656:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:2.0:1736366514.367665:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7351 00000100:00100000:0.0:1736366514.367670:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013072640:12345-0@lo:38:kworker/u8:0.0 Request processed in 30us (109us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366514.367672:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013072832:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366514.367676:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:3.0:1736366514.367684:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366514.367696:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7352 00000100:00100000:1.0:1736366514.367703:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137129300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013072896:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366514.367706:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072960 00000100:00080000:3.0:1736366514.367715:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366514.367719:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366514.367722:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:3.0:1736366514.367724:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013072512:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366514.367726:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013072960:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366514.367732:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366514.367732:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013072832:12345-0@lo:400:kworker/u8:0.0 Request processed in 59us (190us total) trans 0 rc 0/0 00000100:00080000:3.0:1736366514.367738:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366514.367741:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366514.367743:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7351 00000100:00100000:3.0:1736366514.367745:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013072640:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366514.367747:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137129300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013072896:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366514.367755:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013072960:12345-0@lo:38:kworker/u8:0.0 Request processed in 28us (72us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366514.367756:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7352 00000100:00100000:0.0:1736366514.367768:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00080000:3.0:1736366514.367780:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366514.367784:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366514.367788:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013072960:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366514.367789:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366514.367793:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013072576:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366514.367804:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072704 00000100:00100000:0.0:1736366514.367821:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:3.0:1736366514.367822:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072768 00000100:00100000:2.0:1736366514.367824:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013072896:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366514.367825:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013072704:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366514.367833:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013072832:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366514.367846:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77133 00000100:00100000:3.0:1736366514.367852:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d20f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013072768:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366514.367856:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013072704:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366514.367861:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1736366514.367863:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013072448 00010000:02000000:3.0:1736366514.367864:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366514.367877:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013072704:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366514.367885:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1736366514.367889:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013072448:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366514.367903:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d20f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013072768:12345-0@lo:38:kworker/u8:0.0 Request processed in 50us (281us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366514.367914:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77133 00000100:00080000:3.0:1736366514.367940:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366514.367944:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366514.367946:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013072448:12345-0@lo:400:kworker/u8:0.0 Request processed in 54us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366514.367949:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013072768:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366514.367973:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1736366514.367983:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013072448:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366514.535349:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366515.537382:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366516.539395:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366517.119381:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013073024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366517.119452:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366517.119596:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073024 00000100:00100000:0.0:1736366517.119657:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5998 00000100:00100000:0.0:1736366517.119663:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013073024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366517.119694:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366517.119752:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013073024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366517.119760:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5998 00000100:00100000:2.0:1736366517.119785:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013073024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366517.135334:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013073088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366517.135377:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366517.135435:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073088 00000100:00100000:0.0:1736366517.135472:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5999 00000100:00100000:0.0:1736366517.135478:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880135299c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013073088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366517.135500:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366517.135548:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880135299c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013073088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366517.135555:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5999 00000100:00100000:1.0:1736366517.135589:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013073088:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366517.541412:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366518.543444:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366519.151908:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366519.151952:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366519.151990:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366519.152052:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028672 00000100:00100000:2.0:1736366519.152053:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028544 00000100:00100000:1.0:1736366519.152083:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028608 00000100:00100000:0.0:1736366519.152094:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 894 00000100:00100000:2.0:1736366519.152098:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 321 00000100:00100000:0.0:1736366519.152101:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041028672:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366519.152104:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013063e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041028544:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366519.152118:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1166 00000100:00100000:1.0:1736366519.152124:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041028608:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366519.152151:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366519.152194:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013063e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041028544:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 90us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366519.152203:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 321 00000100:00100000:0.0:1736366519.152205:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041028672:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 62us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366519.152213:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 894 00000100:00100000:1.0:1736366519.152227:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041028608:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 102us (237us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366519.152236:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1166 00000100:00080000:0.0:1736366519.375337:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366519.375344:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366519.375347:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366519.375354:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8862 00000100:00080000:0.0:1736366519.375358:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366519.375365:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366519.375383:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13c280 x1820703013073216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366519.375395:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013073152:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366519.375415:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366519.375418:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366519.375419:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366519.375422:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8862 00000100:00080000:0.0:1736366519.375424:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366519.375427:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366519.375435:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13bdc0 x1820703013073344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366519.375436:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013073280:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366519.375456:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366519.375459:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366519.375460:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736366519.375462:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366519.375477:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8862 00000100:00080000:0.0:1736366519.375479:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366519.375483:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366519.375485:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366519.375498:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b1384c0 x1820703013073472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366519.375503:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013073408:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366519.375513:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013073216:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366519.375522:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013073536:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366519.375524:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366519.375526:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1736366519.375527:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366519.375528:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366519.375531:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8862 00000100:00080000:0.0:1736366519.375532:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366519.375535:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366519.375542:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13cc00 x1820703013073664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366519.375547:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366519.375557:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013073600:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366519.375560:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366519.375576:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073536 00000100:00100000:2.0:1736366519.375578:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366519.375590:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073280 00000100:00100000:3.0:1736366519.375598:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013073344:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366519.375608:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073600 00000100:00100000:0.0:1736366519.375612:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7353 00000100:00100000:0.0:1736366519.375618:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352997c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013073536:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366519.375618:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366519.375627:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073408 00000100:00100000:2.0:1736366519.375634:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7354 00000100:00100000:3.0:1736366519.375636:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013073472:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366519.375639:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d60e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013073600:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366519.375640:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073216 00000100:00100000:1.0:1736366519.375648:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073344 00000100:00100000:1.0:1736366519.375657:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1736366519.375657:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366519.375662:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013529c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013073280:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366519.375682:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013073664:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366519.375688:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352997c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013073536:12345-0@lo:400:kworker/u8:0.0 Request processed in 70us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366519.375692:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d60e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013073600:12345-0@lo:400:kworker/u8:0.0 Request processed in 52us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366519.375696:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7353 00000100:00100000:3.0:1736366519.375700:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366519.375703:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013529c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013073280:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366519.375709:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:2.0:1736366519.375712:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7354 00000100:00100000:1.0:1736366519.375722:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073664 00000100:00100000:3.0:1736366519.375726:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073472 00000100:00100000:0.0:1736366519.375728:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:0.0:1736366519.375732:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013073408:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366519.375735:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1736366519.375740:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013073216:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366519.375740:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1736366519.375744:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013073344:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366519.375748:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77134 00010000:02000000:1.0:1736366519.375752:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366519.375753:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013073472:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366519.375755:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366519.375760:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013073408:12345-0@lo:400:kworker/u8:0.0 Request processed in 28us (233us total) trans 0 rc 0/0 00010000:02000000:3.0:1736366519.375764:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366519.375766:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:0.0:1736366519.375778:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:1.0:1736366519.375781:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013073216:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (222us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366519.375782:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013073664:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366519.375787:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:2.0:1736366519.375787:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013073344:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (169us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366519.375791:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013073472:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (135us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366519.375793:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1736366519.375798:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77134 00010000:02000000:0.0:1736366519.375800:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366519.375821:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073152 00000100:00100000:0.0:1736366519.375825:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013073664:12345-0@lo:38:kworker/u8:0.0 Request processed in 43us (125us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366519.375830:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013073408:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366519.375832:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1736366519.375841:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1736366519.375845:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013073152:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366519.375860:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013073600:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366519.375862:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013073536:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366519.375871:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013073152:12345-0@lo:400:kworker/u8:0.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366519.375877:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1736366519.375879:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013073152:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366519.375890:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013073280:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366519.375908:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366519.375911:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366519.375915:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013073472:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366519.375924:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366519.375926:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366519.375928:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013073664:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366519.375947:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366519.375949:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366519.375951:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013073216:0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366519.375958:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366519.375960:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366519.375962:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013073344:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366519.545451:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366520.547411:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366521.549403:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366522.127489:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1736366522.127512:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013073728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366522.127581:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366522.127645:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073728 00000100:00100000:0.0:1736366522.127695:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6000 00000100:00100000:0.0:1736366522.127701:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d61300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013073728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366522.127735:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366522.127800:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d61300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013073728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366522.127807:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6000 00000100:00100000:2.0:1736366522.127847:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099ad5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013073728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366522.143346:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131cadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013073792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366522.143394:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366522.143423:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073792 00000100:00100000:0.0:1736366522.143456:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6001 00000100:00100000:0.0:1736366522.143461:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d60980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013073792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366522.143485:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366522.143537:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d60980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013073792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366522.143544:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6001 00000100:00100000:2.0:1736366522.143599:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131cadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013073792:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366522.551442:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366523.553424:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366524.159661:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366524.159689:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366524.159713:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366524.159716:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028736 00000100:00100000:0.0:1736366524.159733:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028864 00000100:00100000:1.0:1736366524.159741:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028800 00000100:00100000:0.0:1736366524.159753:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 897 00000100:00100000:0.0:1736366524.159756:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b138e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041028864:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366524.159757:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 323 00000100:00100000:3.0:1736366524.159762:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041028736:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366524.159768:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1170 00000100:00100000:1.0:1736366524.159771:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041028800:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366524.159782:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366524.159802:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b138e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041028864:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 46us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366524.159806:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041028736:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 44us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366524.159807:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 897 00000100:00100000:1.0:1736366524.159812:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041028800:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 40us (98us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366524.159813:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 323 00000100:00100000:1.0:1736366524.159816:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1170 00000100:00080000:0.0:1736366524.383272:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366524.383276:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366524.383278:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366524.383283:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8867 00000100:00080000:0.0:1736366524.383287:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366524.383291:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366524.383303:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13f200 x1820703013073920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366524.383324:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736366524.383325:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013073856:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366524.383327:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366524.383327:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366524.383329:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8867 00000100:00080000:0.0:1736366524.383330:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366524.383331:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366524.383336:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13f6c0 x1820703013074048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366524.383344:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366524.383345:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366524.383346:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366524.383347:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8867 00000100:00080000:0.0:1736366524.383348:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366524.383350:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366524.383352:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013073920:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366524.383365:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b139c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013074112:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366524.383368:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13bdc0 x1820703013074176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366524.383376:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366524.383382:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366524.383384:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366524.383385:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366524.383386:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8867 00000100:00080000:0.0:1736366524.383387:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366524.383389:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366524.383392:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366524.383393:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b1384c0 x1820703013074368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366524.383396:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013074304:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366524.383409:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013074048:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366524.383411:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073920 00000100:00100000:1.0:1736366524.383412:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073856 00000100:00100000:2.0:1736366524.383420:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366524.383427:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366524.383429:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736366524.383432:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013074240:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366524.383436:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074048 00000100:00100000:1.0:1736366524.383437:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1736366524.383439:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013074176:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366524.383441:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013073856:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366524.383442:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366524.383445:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:0.0:1736366524.383447:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad4c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013073920:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366524.383454:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013073984:0@lo:400:kworker/u8:0.0 00010000:02000000:0.0:1736366524.383456:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366524.383456:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366524.383467:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013074368:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366524.383469:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366524.383479:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013073856:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366524.383483:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad4c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013073920:12345-0@lo:38:kworker/u8:0.0 Request processed in 35us (92us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366524.383484:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1736366524.383486:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1736366524.383487:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366524.383498:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013073984 00000100:00100000:0.0:1736366524.383499:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074368 00000100:00100000:0.0:1736366524.383503:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:0.0:1736366524.383505:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013074048:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366524.383505:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:02000000:0.0:1736366524.383508:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366524.383509:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:1.0:1736366524.383512:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013074368:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:3.0:1736366524.383513:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366524.383515:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:3.0:1736366524.383516:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013073920:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366524.383517:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013074048:12345-0@lo:38:kworker/u8:0.0 Request processed in 11us (91us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366524.383518:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d617c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013073984:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:1.0:1736366524.383519:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366524.383520:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00080000:3.0:1736366524.383525:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366524.383527:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366524.383529:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013074048:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366524.383530:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074304 00000100:00100000:1.0:1736366524.383536:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013074368:12345-0@lo:38:kworker/u8:0.0 Request processed in 23us (49us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366524.383539:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d617c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013073984:12345-0@lo:400:kworker/u8:0.0 Request processed in 21us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366524.383540:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1736366524.383541:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074240 00000100:00100000:2.0:1736366524.383543:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00080000:3.0:1736366524.383547:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366524.383549:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366524.383551:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013074368:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366524.383555:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366524.383556:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7355 00000100:00100000:2.0:1736366524.383558:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7356 00000100:00100000:0.0:1736366524.383559:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d62140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013074304:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366524.383561:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d66d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013074240:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366524.383569:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074176 00000100:00100000:1.0:1736366524.383570:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074112 00000100:00100000:2.0:1736366524.383573:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d66d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013074240:12345-0@lo:400:kworker/u8:0.0 Request processed in 12us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366524.383576:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7356 00000100:00100000:0.0:1736366524.383577:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d62140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013074304:12345-0@lo:400:kworker/u8:0.0 Request processed in 18us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366524.383580:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7355 00000100:00100000:1.0:1736366524.383583:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1736366524.383583:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77135 00000100:00100000:1.0:1736366524.383585:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cae880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013074112:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366524.383586:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ad1c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013074176:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366524.383591:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366524.383595:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013073984:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366524.383608:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013074240:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366524.383609:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cae880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013074112:12345-0@lo:400:kworker/u8:0.0 Request processed in 23us (54us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366524.383609:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ad1c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013074176:12345-0@lo:38:kworker/u8:0.0 Request processed in 22us (153us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366524.383613:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013074304:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366524.383615:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1736366524.383615:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77135 00000100:00100000:0.0:1736366524.383617:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013073856:0@lo:400:kworker/u8:0.0 00000100:00080000:3.0:1736366524.383633:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1736366524.383635:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366524.383637:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b139c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013074112:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366524.383637:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013074176:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366524.555371:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366525.557417:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366526.559301:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366527.135421:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013074432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366527.135487:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366527.135544:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074432 00000100:00100000:2.0:1736366527.135588:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6002 00000100:00100000:2.0:1736366527.135593:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013074432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366527.135620:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366527.135661:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013074432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366527.135679:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6002 00000100:00100000:0.0:1736366527.135682:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013074432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366527.151327:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013074496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366527.151358:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366527.151397:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074496 00000100:00100000:2.0:1736366527.151423:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6003 00000100:00100000:2.0:1736366527.151427:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013074496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366527.151442:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366527.151475:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013074496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366527.151480:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6003 00000100:00100000:1.0:1736366527.151502:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013074496:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366527.561442:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366528.563426:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366529.168228:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366529.168279:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366529.168324:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366529.168370:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029056 00000100:00100000:2.0:1736366529.168377:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028928 00000100:00100000:3.0:1736366529.168411:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041028992 00000100:00100000:0.0:1736366529.168414:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 900 00000100:00100000:2.0:1736366529.168419:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 325 00000100:00100000:0.0:1736366529.168421:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041029056:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366529.168426:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041028928:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366529.168468:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1174 00000100:00100000:3.0:1736366529.168476:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041028992:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:0.0:1736366529.168486:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041029056:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 65us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366529.168495:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 900 00000100:00100000:2.0:1736366529.168496:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041028928:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 69us (275us total) trans 0 rc 0/0 00010000:02000000:3.0:1736366529.168497:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366529.168503:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 325 00000100:00100000:3.0:1736366529.168562:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041028992:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 85us (236us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366529.168574:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1174 00000100:00080000:0.0:1736366529.391320:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366529.391328:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366529.391332:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366529.391352:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8872 00000100:00080000:0.0:1736366529.391357:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366529.391363:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366529.391386:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13a140 x1820703013074624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366529.391406:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013074560:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366529.391445:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366529.391450:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366529.391452:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366529.391455:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8872 00000100:00080000:0.0:1736366529.391458:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366529.391463:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366529.391472:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013074688:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366529.391476:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13b440 x1820703013074752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366529.391478:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366529.391493:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013074624:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366529.391506:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366529.391509:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736366529.391509:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366529.391511:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366529.391515:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8872 00000100:00080000:0.0:1736366529.391517:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366529.391521:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366529.391532:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13d0c0 x1820703013074880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366529.391534:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366529.391534:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074688 00000100:00100000:1.0:1736366529.391538:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736366529.391546:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013074816:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366529.391558:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013074752:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366529.391563:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366529.391567:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366529.391568:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1736366529.391571:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366529.391572:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8872 00000100:00100000:3.0:1736366529.391573:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074624 00000100:00080000:0.0:1736366529.391582:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366529.391585:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366529.391594:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013074944:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366529.391594:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074816 00000100:00100000:0.0:1736366529.391599:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b139300 x1820703013075072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366529.391603:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:3.0:1736366529.391610:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cae3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013074688:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366529.391617:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1736366529.391621:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366529.391621:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013074816:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366529.391646:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:1.0:1736366529.391650:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074560 00000100:00100000:0.0:1736366529.391652:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d60980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013074624:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366529.391654:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cae3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013074688:12345-0@lo:400:kworker/u8:0.0 Request processed in 44us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366529.391656:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013074816:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366529.391662:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00010000:02000000:0.0:1736366529.391667:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366529.391671:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1736366529.391676:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1736366529.391681:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013074560:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366529.391691:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013075008:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366529.391694:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366529.391724:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d60980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013074624:12345-0@lo:38:kworker/u8:0.0 Request processed in 70us (189us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366529.391729:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013074880:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366529.391731:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366529.391732:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013074560:12345-0@lo:400:kworker/u8:0.0 Request processed in 51us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366529.391733:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:1.0:1736366529.391740:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1736366529.391753:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074752 00000100:00100000:2.0:1736366529.391753:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366529.391759:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013074560:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366529.391772:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366529.391774:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366529.391776:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1736366529.391777:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013074624:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366529.391778:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013074816:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366529.391781:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d64740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013074752:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366529.391789:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074944 00010000:02000000:0.0:1736366529.391790:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366529.391793:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013075072:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366529.391799:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013074688:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366529.391812:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366529.391813:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075008 00000100:00100000:0.0:1736366529.391821:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d64740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013074752:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (125us total) trans 0 rc -19/-19 00000100:00080000:2.0:1736366529.391824:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366529.391826:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366529.391828:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1736366529.391828:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013074752:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366529.391831:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7357 00000100:00100000:1.0:1736366529.391832:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075072 00000100:00100000:3.0:1736366529.391836:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013074944:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366529.391876:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7358 00000100:00100000:2.0:1736366529.391880:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013075008:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366529.391883:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1736366529.391887:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d63dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013075072:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366529.391914:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366529.391931:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013075008:12345-0@lo:400:kworker/u8:0.0 Request processed in 51us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366529.391931:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013074944:12345-0@lo:400:kworker/u8:0.0 Request processed in 94us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366529.391937:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7358 00000100:00100000:3.0:1736366529.391941:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7357 00000100:00100000:2.0:1736366529.391967:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013075008:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366529.391967:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013074880 00000100:00100000:1.0:1736366529.391968:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d63dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013075072:12345-0@lo:38:kworker/u8:0.0 Request processed in 79us (155us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366529.391976:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00080000:2.0:1736366529.391984:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366529.391987:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366529.391988:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77136 00000100:00100000:2.0:1736366529.391989:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013075072:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366529.391993:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d63900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013074880:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366529.392001:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366529.392004:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013074944:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366529.392042:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d63900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013074880:12345-0@lo:38:kworker/u8:0.0 Request processed in 48us (287us total) trans 0 rc -19/-19 00000100:00080000:2.0:1736366529.392045:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366529.392048:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366529.392049:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77136 00000100:00100000:2.0:1736366529.392050:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013074880:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366529.565427:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366530.567462:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366531.569446:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366532.143407:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013075136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366532.143476:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366532.143540:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075136 00000100:00100000:2.0:1736366532.143601:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6004 00000100:00100000:2.0:1736366532.143608:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013075136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366532.143639:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366532.143700:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013075136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366532.143709:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6004 00000100:00100000:1.0:1736366532.143750:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013075136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366532.159393:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131cac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013075200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366532.159436:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366532.159495:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075200 00000100:00100000:2.0:1736366532.159541:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6005 00000100:00100000:2.0:1736366532.159546:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1397c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013075200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366532.159568:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366532.159611:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1397c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013075200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366532.159618:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6005 00000100:00100000:0.0:1736366532.159629:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131cac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013075200:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366532.571511:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366533.573425:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366534.176067:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366534.176118:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366534.176159:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366534.176219:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029120 00000100:00100000:3.0:1736366534.176219:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029248 00000100:00100000:0.0:1736366534.176227:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029184 00000100:00100000:0.0:1736366534.176268:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 903 00000100:00100000:1.0:1736366534.176275:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 327 00000100:00100000:0.0:1736366534.176276:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041029248:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366534.176284:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041029120:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366534.176285:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1178 00000100:00100000:3.0:1736366534.176292:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b139c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041029184:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366534.176310:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366534.176352:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041029248:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 77us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366534.176360:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041029120:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366534.176361:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 903 00000100:00100000:3.0:1736366534.176363:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b139c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041029184:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 70us (203us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366534.176372:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 327 00000100:00100000:3.0:1736366534.176373:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1178 00000100:00080000:0.0:1736366534.399330:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366534.399337:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366534.399340:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366534.399346:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8877 00000100:00080000:0.0:1736366534.399350:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366534.399356:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366534.399375:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b138980 x1820703013075328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366534.399408:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366534.399412:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366534.399413:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366534.399416:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8877 00000100:00080000:0.0:1736366534.399418:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366534.399420:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366534.399428:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13f6c0 x1820703013075456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366534.399431:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013075264:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366534.399441:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366534.399444:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366534.399445:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366534.399448:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8877 00000100:00080000:0.0:1736366534.399449:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366534.399452:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366534.399462:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013075328:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366534.399478:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13e3c0 x1820703013075584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366534.399489:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013075520:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366534.399500:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366534.399503:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366534.399506:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366534.399507:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366534.399510:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8877 00000100:00080000:0.0:1736366534.399512:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366534.399515:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366534.399522:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b139300 x1820703013075776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366534.399530:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366534.399537:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013075712:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366534.399550:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013075392:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366534.399562:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075264 00000100:00100000:2.0:1736366534.399577:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366534.399584:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366534.399587:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013075648:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366534.399595:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1736366534.399601:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013075264:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366534.399608:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075712 00000100:00100000:1.0:1736366534.399618:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366534.399619:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366534.399637:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075648 00000100:00100000:3.0:1736366534.399639:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013075456:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366534.399653:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7359 00000100:00100000:0.0:1736366534.399655:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013075264:12345-0@lo:400:kworker/u8:0.0 Request processed in 53us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366534.399658:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d65580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013075712:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366534.399662:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1736366534.399664:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7360 00000100:00100000:3.0:1736366534.399668:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366534.399673:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cad0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013075648:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366534.399689:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013075584:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366534.399693:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d65580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013075712:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366534.399695:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075520 00000100:00100000:2.0:1736366534.399700:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7359 00000100:00100000:0.0:1736366534.399714:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075392 00000100:00100000:3.0:1736366534.399716:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366534.399721:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cad0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013075648:12345-0@lo:400:kworker/u8:0.0 Request processed in 50us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366534.399724:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075328 00000100:00100000:3.0:1736366534.399730:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013075776:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366534.399732:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075456 00000100:00100000:1.0:1736366534.399732:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7360 00000100:00100000:2.0:1736366534.399739:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:0.0:1736366534.399743:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1736366534.399744:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013075520:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366534.399747:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013075392:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366534.399754:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366534.399817:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013075648:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366534.399819:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075584 00000100:00100000:2.0:1736366534.399824:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013075520:12345-0@lo:400:kworker/u8:0.0 Request processed in 79us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366534.399825:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013075392:12345-0@lo:400:kworker/u8:0.0 Request processed in 77us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366534.399830:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:0.0:1736366534.399834:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1736366534.399846:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075776 00000100:00100000:3.0:1736366534.399846:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77137 00000100:00100000:0.0:1736366534.399848:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1736366534.399851:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013075328:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366534.399853:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b697c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013075584:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366534.399858:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:2.0:1736366534.399861:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b68e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013075456:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366534.399869:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013075520:0@lo:400:kworker/u8:0.0 00010000:02000000:0.0:1736366534.399872:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366534.399872:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736366534.399878:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366534.399903:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b68e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013075456:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (236us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366534.399908:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013075328:12345-0@lo:38:kworker/u8:0.0 Request processed in 55us (290us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366534.399909:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1736366534.399914:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:2.0:1736366534.399918:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1736366534.399922:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013075776:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366534.399922:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b697c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013075584:12345-0@lo:38:kworker/u8:0.0 Request processed in 68us (205us total) trans 0 rc -19/-19 00010000:02000000:2.0:1736366534.399928:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366534.399932:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77137 00000100:00100000:2.0:1736366534.399943:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013075776:12345-0@lo:38:kworker/u8:0.0 Request processed in 21us (191us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366534.399949:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1736366534.399968:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013075392:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366534.399975:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013075712:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366534.399983:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013075264:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366534.400012:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366534.400015:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366534.400018:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013075584:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366534.400025:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366534.400027:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366534.400037:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013075776:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366534.400048:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366534.400050:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366534.400052:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013075328:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366534.400059:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366534.400061:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366534.400063:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013075456:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366534.575423:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366535.577405:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366536.579437:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366537.151410:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131cad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013075840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366537.151481:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366537.151628:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075840 00000100:00100000:2.0:1736366537.151691:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6006 00000100:00100000:2.0:1736366537.151697:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013075840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366537.151771:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366537.151835:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013075840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366537.151843:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6006 00000100:00100000:3.0:1736366537.151883:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131cad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013075840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366537.167406:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013075904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366537.167448:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366537.167513:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075904 00000100:00100000:0.0:1736366537.167555:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6007 00000100:00100000:0.0:1736366537.167560:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d663c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013075904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366537.167583:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366537.167626:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d663c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013075904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366537.167632:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6007 00000100:00100000:2.0:1736366537.167646:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013075904:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366537.581429:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366538.583488:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366539.184242:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366539.184291:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366539.184335:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366539.184379:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029312 00000100:00100000:3.0:1736366539.184395:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029440 00000100:00100000:1.0:1736366539.184421:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029376 00000100:00100000:2.0:1736366539.184443:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 329 00000100:00100000:2.0:1736366539.184451:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041029312:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366539.184451:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 906 00000100:00100000:3.0:1736366539.184460:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041029440:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366539.184465:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1182 00000100:00100000:1.0:1736366539.184472:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041029376:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366539.184492:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366539.184521:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041029312:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 72us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366539.184529:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041029440:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366539.184538:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:1873:x1820703041029376:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 65us (203us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366539.184541:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 906 00000100:00100000:2.0:1736366539.184547:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 329 00000100:00100000:1.0:1736366539.184548:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1182 00000100:00080000:0.0:1736366539.407330:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366539.407337:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366539.407341:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366539.407348:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8882 00000100:00080000:0.0:1736366539.407352:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366539.407359:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366539.407378:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13e880 x1820703013076032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366539.407407:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366539.407410:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366539.407411:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366539.407414:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8882 00000100:00100000:1.0:1736366539.407429:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013075968:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366539.407430:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1736366539.407432:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013076096:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366539.407434:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366539.407448:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13df00 x1820703013076160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366539.407457:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013076032:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366539.407472:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366539.407475:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366539.407476:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366539.407479:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8882 00000100:00080000:0.0:1736366539.407481:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366539.407483:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366539.407491:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b138980 x1820703013076288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366539.407509:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366539.407511:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366539.407512:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366539.407515:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8882 00000100:00080000:0.0:1736366539.407516:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1736366539.407517:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366539.407518:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366539.407519:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366539.407525:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013076224:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366539.407526:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13bdc0 x1820703013076480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366539.407559:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013076416:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366539.407561:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366539.407568:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013076352:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366539.407571:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013075968 00000100:00100000:1.0:1736366539.407590:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366539.407599:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366539.407607:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1736366539.407612:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013075968:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366539.407614:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076416 00000100:00100000:3.0:1736366539.407634:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013076160:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366539.407642:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7361 00000100:00100000:2.0:1736366539.407647:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013076416:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366539.407666:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076096 00000100:00100000:3.0:1736366539.407667:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366539.407669:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013075968:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366539.407723:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1736366539.407727:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013076288:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366539.407733:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013076416:12345-0@lo:400:kworker/u8:0.0 Request processed in 85us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366539.407740:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076224 00000100:00100000:2.0:1736366539.407740:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7361 00000100:00100000:1.0:1736366539.407757:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076032 00000100:00100000:2.0:1736366539.407764:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366539.407769:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076160 00000100:00100000:0.0:1736366539.407777:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1736366539.407784:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d62ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013076096:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366539.407785:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366539.407787:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076352 00000100:00100000:1.0:1736366539.407797:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:2.0:1736366539.407803:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7362 00000100:00100000:1.0:1736366539.407804:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013076224:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366539.407804:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013076480:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366539.407807:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d650c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013076352:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366539.407822:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d62ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013076096:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366539.407828:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:3.0:1736366539.407839:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366539.407844:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1736366539.407845:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d650c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013076352:12345-0@lo:400:kworker/u8:0.0 Request processed in 36us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366539.407848:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013076032:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366539.407850:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7362 00000100:00100000:1.0:1736366539.407854:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013076224:12345-0@lo:400:kworker/u8:0.0 Request processed in 50us (294us total) trans 0 rc 0/0 00010000:02000000:0.0:1736366539.407861:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366539.407865:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:3.0:1736366539.407872:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076480 00000100:00100000:2.0:1736366539.407878:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b139300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013076352:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366539.407885:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013076032:12345-0@lo:38:kworker/u8:0.0 Request processed in 36us (287us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366539.407886:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1736366539.407892:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013076160:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366539.407892:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:3.0:1736366539.407897:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013076480:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366539.407903:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00010000:02000000:1.0:1736366539.407905:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736366539.407906:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366539.407916:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076288 00000100:00100000:2.0:1736366539.407932:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77138 00000100:00100000:0.0:1736366539.407933:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013076096:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366539.407936:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b69300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013076288:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366539.407943:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013076160:12345-0@lo:38:kworker/u8:0.0 Request processed in 50us (277us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366539.407943:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013076480:12345-0@lo:38:kworker/u8:0.0 Request processed in 44us (104us total) trans 0 rc -19/-19 00010000:02000000:2.0:1736366539.407946:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366539.407953:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:1.0:1736366539.407956:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00080000:0.0:1736366539.407959:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366539.407962:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366539.407965:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013076160:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366539.407969:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b69300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013076288:12345-0@lo:38:kworker/u8:0.0 Request processed in 33us (188us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736366539.407974:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366539.407976:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366539.407979:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013076288:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366539.407989:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366539.407991:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366539.407991:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013076416:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366539.407991:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77138 00000100:00100000:3.0:1736366539.407991:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013076224:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366539.407993:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013076480:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366539.408001:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1736366539.408006:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013075968:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366539.408010:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366539.408013:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013076032:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366539.585464:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366540.587490:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366541.589413:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366542.159425:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736366542.159447:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013076544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366542.159514:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366542.159578:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076544 00000100:00100000:0.0:1736366542.159676:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6008 00000100:00100000:0.0:1736366542.159682:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caf200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013076544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366542.159715:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366542.159779:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caf200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013076544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366542.159786:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6008 00000100:00100000:1.0:1736366542.159826:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013076544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366542.175400:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013076608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366542.175443:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366542.175471:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076608 00000100:00100000:0.0:1736366542.175517:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6009 00000100:00100000:0.0:1736366542.175522:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013076608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366542.175546:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366542.175597:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013076608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366542.175604:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6009 00000100:00100000:3.0:1736366542.175656:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013076608:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366542.591439:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366543.593507:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366544.192229:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366544.192276:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366544.192319:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366544.192330:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029504 00000100:00100000:0.0:1736366544.192355:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029632 00000100:00100000:0.0:1736366544.192386:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029568 00000100:00100000:2.0:1736366544.192391:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 331 00000100:00100000:2.0:1736366544.192401:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041029504:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366544.192412:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 909 00000100:00100000:0.0:1736366544.192418:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041029632:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366544.192430:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1186 00000100:00100000:1.0:1736366544.192441:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041029568:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366544.192464:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366544.192476:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041029632:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 57us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366544.192484:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 909 00000100:00100000:2.0:1736366544.192492:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041029504:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366544.192504:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 331 00000100:00100000:1.0:1736366544.192512:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041029568:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 71us (192us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366544.192524:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1186 00000100:00080000:0.0:1736366544.415345:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366544.415352:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366544.415355:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366544.415362:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8887 00000100:00080000:0.0:1736366544.415366:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366544.415373:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366544.415391:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13df00 x1820703013076736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366544.415419:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013076672:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366544.415430:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366544.415434:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366544.415435:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366544.415438:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8887 00000100:00080000:0.0:1736366544.415440:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366544.415443:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366544.415451:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13b900 x1820703013076864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366544.415464:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366544.415467:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366544.415468:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366544.415470:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8887 00000100:00080000:0.0:1736366544.415473:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366544.415476:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366544.415481:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013076736:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366544.415481:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013076800:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366544.415484:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13f200 x1820703013076992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366544.415506:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736366544.415511:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366544.415526:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366544.415527:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366544.415532:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8887 00000100:00080000:0.0:1736366544.415533:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366544.415536:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366544.415545:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13e3c0 x1820703013077184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366544.415561:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366544.415572:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013076928:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366544.415573:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013077120:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366544.415595:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076672 00000100:00100000:3.0:1736366544.415653:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013077056:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366544.415659:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366544.415665:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366544.415683:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1736366544.415692:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013076672:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366544.415694:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366544.415702:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076800 00000100:00100000:2.0:1736366544.415721:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077120 00000100:00100000:0.0:1736366544.415728:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076928 00000100:00100000:0.0:1736366544.415743:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:3.0:1736366544.415746:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077056 00000100:00100000:0.0:1736366544.415748:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013076800:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366544.415750:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013076672:12345-0@lo:400:kworker/u8:0.0 Request processed in 58us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366544.415758:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7363 00000100:00100000:1.0:1736366544.415761:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1736366544.415766:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d67200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013077120:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366544.415779:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7364 00000100:00100000:3.0:1736366544.415785:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013077056:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366544.415786:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013076800:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366544.415792:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1736366544.415799:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366544.415810:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:0.0:1736366544.415813:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013076928:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366544.415819:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d67200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013077120:12345-0@lo:400:kworker/u8:0.0 Request processed in 53us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366544.415830:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7363 00000100:00100000:1.0:1736366544.415834:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013076864:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366544.415838:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013077056:12345-0@lo:400:kworker/u8:0.0 Request processed in 53us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366544.415841:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013076928:12345-0@lo:400:kworker/u8:0.0 Request processed in 27us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366544.415847:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:3.0:1736366544.415856:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7364 00000100:00100000:0.0:1736366544.415857:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076736 00000100:00100000:1.0:1736366544.415865:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366544.415869:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076864 00000100:00100000:0.0:1736366544.415877:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:0.0:1736366544.415880:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013076736:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366544.415882:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013076992:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366544.415884:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013077120:0@lo:400:kworker/u8:0.0 00010000:02000000:0.0:1736366544.415894:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366544.415894:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1736366544.415899:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013076864:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366544.415900:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013076672:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366544.415909:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1736366544.415913:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366544.415927:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013077184:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366544.415935:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013076736:12345-0@lo:38:kworker/u8:0.0 Request processed in 53us (136us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366544.415942:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1736366544.415949:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013076864:12345-0@lo:38:kworker/u8:0.0 Request processed in 48us (83us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366544.415950:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366544.415951:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013076992 00000100:00100000:3.0:1736366544.415957:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1736366544.415972:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077184 00000100:00100000:2.0:1736366544.415979:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77139 00000100:00080000:1.0:1736366544.415984:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366544.415986:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013076992:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366544.415988:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00080000:1.0:1736366544.415989:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366544.415991:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caf6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013077184:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366544.415994:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013076736:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366544.415995:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013076800:0@lo:400:kworker/u8:0.0 00010000:02000000:0.0:1736366544.415998:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736366544.416005:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366544.416009:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00010000:02000000:2.0:1736366544.416009:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366544.416013:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013076864:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366544.416016:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caf6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013077184:12345-0@lo:38:kworker/u8:0.0 Request processed in 24us (66us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366544.416021:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1736366544.416031:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013077056:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366544.416039:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366544.416043:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366544.416046:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013077184:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366544.416048:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b1384c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013076928:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366544.416054:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013076992:12345-0@lo:38:kworker/u8:0.0 Request processed in 67us (143us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366544.416063:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366544.416064:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77139 00000100:00080000:1.0:1736366544.416066:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366544.416070:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013076992:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366544.595474:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366545.597399:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366546.599475:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366547.167503:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736366547.167545:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013077248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366547.167676:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366547.167759:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077248 00000100:00100000:0.0:1736366547.167830:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6010 00000100:00100000:0.0:1736366547.167839:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caaac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013077248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366547.167875:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366547.167947:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caaac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013077248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366547.167958:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6010 00000100:00100000:1.0:1736366547.167986:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013077248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366547.183351:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736366547.183368:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099b6b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013077312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366547.183413:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366547.183497:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077312 00000100:00100000:2.0:1736366547.183550:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6011 00000100:00100000:2.0:1736366547.183581:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1384c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013077312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366547.183608:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366547.183664:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1384c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013077312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366547.183673:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6011 00000100:00100000:0.0:1736366547.183678:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099b6b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013077312:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366547.601437:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366548.603497:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366549.199988:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366549.200055:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366549.200124:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366549.200142:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029696 00000100:00100000:0.0:1736366549.200196:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029824 00000100:00100000:2.0:1736366549.200217:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029760 00000100:00100000:1.0:1736366549.200232:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 333 00000100:00100000:1.0:1736366549.200240:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041029696:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366549.200254:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 912 00000100:00100000:2.0:1736366549.200261:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b139300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041029824:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366549.200271:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1190 00000100:00100000:0.0:1736366549.200279:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041029760:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:0.0:1736366549.200300:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366549.200312:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041029696:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 72us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366549.200319:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 333 00000100:00100000:2.0:1736366549.200321:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b139300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041029824:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 61us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366549.200329:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 912 00000100:00100000:0.0:1736366549.200347:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041029760:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 67us (224us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366549.200357:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1190 00000100:00080000:0.0:1736366549.423362:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366549.423372:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366549.423377:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366549.423386:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8892 00000100:00080000:0.0:1736366549.423391:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366549.423399:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366549.423426:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13d0c0 x1820703013077440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366549.423431:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736366549.423457:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013077376:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366549.423474:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366549.423479:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366549.423481:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736366549.423483:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1736366549.423486:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8892 00000100:00080000:0.0:1736366549.423489:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1736366549.423494:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366549.423505:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013077504:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366549.423510:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b13df00 x1820703013077568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366549.423512:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013077440:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366549.423570:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366549.423575:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366549.423579:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366549.423582:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366549.423600:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8892 00000100:00080000:0.0:1736366549.423604:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:1.0:1736366549.423606:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366549.423610:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366549.423624:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077376 00000100:00100000:0.0:1736366549.423626:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88009b138980 x1820703013077696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366549.423640:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077440 00000100:00100000:1.0:1736366549.423651:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013077568:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366549.423657:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00080000:0.0:1736366549.423663:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1736366549.423663:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013077376:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366549.423668:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366549.423670:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366549.423674:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8892 00000100:00080000:0.0:1736366549.423676:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00100000:3.0:1736366549.423678:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00080000:0.0:1736366549.423680:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366549.423682:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366549.423684:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013077440:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366549.423693:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a163c0 x1820703013077888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366549.423702:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013077696:0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366549.423702:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366549.423705:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013077376:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366549.423722:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1736366549.423731:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013077632:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366549.423732:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366549.423738:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013077440:12345-0@lo:38:kworker/u8:0.0 Request processed in 53us (134us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366549.423748:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:2.0:1736366549.423758:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077568 00000100:00080000:1.0:1736366549.423764:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366549.423769:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366549.423772:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366549.423774:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013077440:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366549.423775:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:2.0:1736366549.423779:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cacc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013077568:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366549.423789:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366549.423797:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a163c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013077888:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366549.423802:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077504 00000100:00100000:3.0:1736366549.423827:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013077824:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366549.423834:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cacc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013077568:12345-0@lo:38:kworker/u8:0.0 Request processed in 53us (153us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366549.423836:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366549.423841:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:0.0:1736366549.423848:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b68980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013077504:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366549.423848:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:2.0:1736366549.423858:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077888 00000100:00080000:1.0:1736366549.423860:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366549.423860:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736366549.423864:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366549.423866:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1736366549.423868:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013077568:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366549.423869:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013077888:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366549.423875:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366549.423893:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013077760:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366549.423899:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013077888:12345-0@lo:38:kworker/u8:0.0 Request processed in 29us (64us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366549.423905:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1736366549.423908:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b68980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013077504:12345-0@lo:400:kworker/u8:0.0 Request processed in 60us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366549.423908:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077824 00000100:00100000:0.0:1736366549.423918:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1736366549.423924:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366549.423929:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013077376:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366549.423944:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077760 00000100:00100000:2.0:1736366549.423956:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7365 00000100:00100000:0.0:1736366549.423959:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077696 00000100:00100000:2.0:1736366549.423960:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013077824:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366549.423964:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366549.423976:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366549.423982:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a163c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013077888:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366549.423985:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77140 00000100:00100000:3.0:1736366549.423985:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7366 00000100:00100000:2.0:1736366549.423986:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013077824:12345-0@lo:400:kworker/u8:0.0 Request processed in 26us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366549.423993:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013077696:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366549.423994:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7365 00000100:00100000:3.0:1736366549.423994:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cad580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013077760:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:0.0:1736366549.424006:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366549.424049:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cad580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013077760:12345-0@lo:400:kworker/u8:0.0 Request processed in 56us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366549.424055:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013077696:12345-0@lo:38:kworker/u8:0.0 Request processed in 62us (322us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366549.424058:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7366 00000100:00100000:1.0:1736366549.424067:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013077760:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366549.424074:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77140 00000100:00100000:3.0:1736366549.424097:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013077824:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366549.424098:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366549.424101:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1736366549.424101:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366549.424105:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b138980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013077696:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366549.424110:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013077504:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366549.424160:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077632 00000100:00100000:2.0:1736366549.424224:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:2.0:1736366549.424228:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a13440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013077632:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366549.424271:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a13440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013077632:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366549.424285:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:0.0:1736366549.424336:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013077632:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366549.605434:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366550.607584:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366551.609444:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366552.175409:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736366552.175435:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131cac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013077952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366552.175542:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366552.175609:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013077952 00000100:00100000:2.0:1736366552.175672:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6012 00000100:00100000:2.0:1736366552.175678:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b684c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013077952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366552.175710:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366552.175773:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b684c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013077952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366552.175781:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6012 00000100:00100000:3.0:1736366552.175818:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131cac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013077952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366552.191366:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013078016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366552.191408:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366552.191471:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078016 00000100:00100000:0.0:1736366552.191533:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6013 00000100:00100000:0.0:1736366552.191538:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d61c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013078016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366552.191561:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366552.191604:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d61c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013078016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366552.191610:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6013 00000100:00100000:2.0:1736366552.191625:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013078016:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366552.611535:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366553.613484:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366554.208080:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366554.208142:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366554.208230:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029888 00000100:00100000:0.0:1736366554.208247:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366554.208293:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 335 00000100:00100000:2.0:1736366554.208304:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041029888:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366554.208306:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030016 00000100:00100000:1.0:1736366554.208337:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041029952 00000100:00100000:3.0:1736366554.208373:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 915 00000100:00100000:3.0:1736366554.208382:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a16d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041030016:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366554.208385:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1194 00000100:00100000:1.0:1736366554.208392:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041029952:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:2.0:1736366554.208393:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041029888:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 90us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366554.208402:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 335 00010000:02000000:1.0:1736366554.208412:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366554.208438:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a16d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041030016:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 57us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366554.208485:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041029952:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 92us (240us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366554.208486:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 915 00000100:00100000:1.0:1736366554.208496:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1194 00000100:00080000:0.0:1736366554.431333:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366554.431339:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366554.431342:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366554.431349:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8897 00000100:00080000:0.0:1736366554.431353:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366554.431359:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366554.431379:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a13dc0 x1820703013078144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366554.431412:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366554.431416:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366554.431417:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366554.431420:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8897 00000100:00080000:0.0:1736366554.431464:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00100000:1.0:1736366554.431465:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013078080:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366554.431469:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366554.431482:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a14c00 x1820703013078272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366554.431484:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1736366554.431503:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a14280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013078208:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366554.431518:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366554.431521:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1736366554.431521:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013078144:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366554.431522:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366554.431526:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8897 00000100:00080000:0.0:1736366554.431527:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366554.431530:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366554.431540:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a11c80 x1820703013078400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366554.431556:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366554.431561:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366554.431564:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366554.431565:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366554.431568:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8897 00000100:00080000:0.0:1736366554.431569:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1736366554.431572:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366554.431572:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366554.431580:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a12140 x1820703013078592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366554.431582:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736366554.431594:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a176c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013078336:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366554.431595:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013078528:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366554.431609:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013078464:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366554.431625:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078080 00000100:00100000:1.0:1736366554.431629:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366554.431629:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366554.431661:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1736366554.431665:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366554.431667:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013078080:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366554.431677:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366554.431685:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078528 00000100:00100000:3.0:1736366554.431710:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013078272:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366554.431711:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078464 00000100:00100000:1.0:1736366554.431724:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7367 00000100:00100000:0.0:1736366554.431725:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013078080:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366554.431731:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cac280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013078528:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366554.431740:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7368 00000100:00100000:3.0:1736366554.431742:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366554.431743:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1736366554.431745:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d604c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013078464:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366554.431765:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a11c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013078400:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366554.431779:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cac280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013078528:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366554.431785:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d604c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013078464:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366554.431788:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078208 00000100:00100000:1.0:1736366554.431790:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7367 00000100:00100000:3.0:1736366554.431796:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366554.431808:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7368 00000100:00100000:0.0:1736366554.431811:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078336 00000100:00100000:3.0:1736366554.431813:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013078592:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366554.431823:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078144 00000100:00100000:2.0:1736366554.431832:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078272 00000100:00100000:0.0:1736366554.431833:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:0.0:1736366554.431837:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d62f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013078208:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366554.431842:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366554.431845:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:2.0:1736366554.431849:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013078336:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366554.431853:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013078528:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366554.431868:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a16880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013078080:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366554.431869:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078592 00000100:00100000:0.0:1736366554.431872:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d62f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013078208:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366554.431878:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:2.0:1736366554.431881:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013078336:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366554.431887:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:3.0:1736366554.431893:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1736366554.431898:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:3.0:1736366554.431899:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013078144:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366554.431902:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:0.0:1736366554.431903:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013078272:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366554.431905:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013078592:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366554.431917:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366554.431917:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736366554.431918:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366554.431923:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078400 00000100:00100000:1.0:1736366554.431945:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77141 00000100:00100000:0.0:1736366554.431946:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013078272:12345-0@lo:38:kworker/u8:0.0 Request processed in 44us (205us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366554.431949:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013078592:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (108us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366554.431951:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013078400:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366554.431952:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1736366554.431955:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1736366554.431956:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013078144:12345-0@lo:38:kworker/u8:0.0 Request processed in 56us (280us total) trans 0 rc -19/-19 00010000:02000000:1.0:1736366554.431961:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366554.431965:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00080000:0.0:1736366554.431979:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366554.431981:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366554.431985:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013078592:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366554.431986:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a14280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013078208:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366554.431994:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013078400:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (196us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736366554.431995:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366554.431997:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366554.432000:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013078144:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366554.432003:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77141 00000100:00100000:3.0:1736366554.432007:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a176c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013078336:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366554.432008:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366554.432008:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013078464:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366554.432010:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366554.432013:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a14c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013078272:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366554.432047:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366554.432050:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366554.432052:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a11c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013078400:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366554.615353:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366555.617387:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366556.619451:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366557.183470:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9ca600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013078656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366557.183539:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366557.183608:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078656 00000100:00100000:2.0:1736366557.183670:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6014 00000100:00100000:2.0:1736366557.183677:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a11c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013078656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366557.183708:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366557.183791:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a11c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013078656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366557.183799:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6014 00000100:00100000:0.0:1736366557.183827:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9ca600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013078656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366557.199378:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736366557.199417:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013078720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366557.199461:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366557.199520:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078720 00000100:00100000:2.0:1736366557.199559:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6015 00000100:00100000:2.0:1736366557.199564:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cabdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013078720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366557.199586:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366557.199635:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cabdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013078720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366557.199642:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6015 00000100:00100000:1.0:1736366557.199682:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013078720:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366557.621445:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366558.623430:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366559.215844:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366559.215887:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366559.215922:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366559.215965:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030208 00000100:00100000:2.0:1736366559.215966:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030080 00000100:00100000:3.0:1736366559.215999:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030144 00000100:00100000:0.0:1736366559.216006:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 918 00000100:00100000:0.0:1736366559.216013:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a14c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041030208:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366559.216023:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 337 00000100:00100000:2.0:1736366559.216029:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041030080:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366559.216042:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1198 00000100:00100000:3.0:1736366559.216050:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a13dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041030144:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366559.216071:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366559.216079:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a14c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041030208:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 66us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366559.216085:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041030080:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 56us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366559.216087:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 918 00000100:00100000:2.0:1736366559.216092:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 337 00000100:00100000:3.0:1736366559.216117:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a13dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:1873:x1820703041030144:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 66us (193us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366559.216128:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1198 00000100:00080000:0.0:1736366559.439316:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366559.439322:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366559.439325:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366559.439331:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8902 00000100:00080000:0.0:1736366559.439335:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366559.439339:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366559.439386:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a150c0 x1820703013078848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366559.439409:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366559.439423:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366559.439424:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1736366559.439427:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013078784:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366559.439428:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8902 00000100:00080000:0.0:1736366559.439429:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366559.439433:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366559.439441:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013078912:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366559.439444:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a15f00 x1820703013078976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366559.439464:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366559.439467:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366559.439468:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366559.439470:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8902 00000100:00080000:0.0:1736366559.439472:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366559.439475:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366559.439482:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a13900 x1820703013079104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366559.439488:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366559.439497:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366559.439500:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366559.439503:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366559.439504:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366559.439507:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8902 00000100:00080000:0.0:1736366559.439508:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1736366559.439511:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366559.439517:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a14740 x1820703013079296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366559.439532:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a15580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013079232:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366559.439540:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013078848:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366559.439552:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013079040:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366559.439558:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366559.439574:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078784 00000100:00100000:0.0:1736366559.439577:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366559.439597:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079232 00000100:00100000:2.0:1736366559.439600:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078912 00000100:00100000:0.0:1736366559.439605:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a15f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013078976:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366559.439613:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1736366559.439620:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013078784:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366559.439623:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078848 00000100:00100000:0.0:1736366559.439624:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366559.439630:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7369 00000100:00100000:0.0:1736366559.439634:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013079104:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366559.439635:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013078976 00000100:00100000:1.0:1736366559.439636:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d64c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013079232:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366559.439647:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:0.0:1736366559.439651:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366559.439652:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cadf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013078912:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366559.439667:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013079296:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366559.439690:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013078784:12345-0@lo:400:kworker/u8:0.0 Request processed in 68us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366559.439691:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366559.439697:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d64c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013079232:12345-0@lo:400:kworker/u8:0.0 Request processed in 61us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366559.439697:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cadf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013078912:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366559.439701:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1736366559.439705:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7369 00000100:00100000:0.0:1736366559.439714:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a10e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013079168:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366559.439715:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:0.0:1736366559.439731:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366559.439731:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079296 00000100:00100000:1.0:1736366559.439740:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1736366559.439745:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013078848:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366559.439753:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1736366559.439758:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013078976:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366559.439760:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a15580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013079232:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366559.439761:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1736366559.439765:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a14280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013079296:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366559.439767:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366559.439769:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366559.439775:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013078784:0@lo:400:kworker/u8:0.0 00010000:02000000:0.0:1736366559.439776:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366559.439803:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013078976:12345-0@lo:38:kworker/u8:0.0 Request processed in 45us (178us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366559.439809:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a14280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013079296:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (117us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366559.439809:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1736366559.439813:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013078848:12345-0@lo:38:kworker/u8:0.0 Request processed in 65us (235us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366559.439815:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1736366559.439823:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1736366559.439837:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013078912:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366559.439846:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366559.439846:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079104 00000100:00080000:0.0:1736366559.439849:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366559.439851:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079168 00000100:00100000:0.0:1736366559.439853:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013078848:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366559.439860:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366559.439861:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366559.439864:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a15f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013078976:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366559.439870:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366559.439872:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366559.439874:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a14740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013079296:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366559.439875:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7370 00000100:00100000:3.0:1736366559.439875:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77142 00000100:00100000:1.0:1736366559.439881:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a16880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013079168:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366559.439881:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a12ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013079104:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366559.439892:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366559.439926:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a16880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013079168:12345-0@lo:400:kworker/u8:0.0 Request processed in 44us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366559.439926:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a12ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013079104:12345-0@lo:38:kworker/u8:0.0 Request processed in 44us (273us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366559.439934:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7370 00000100:00100000:3.0:1736366559.439934:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77142 00000100:00100000:0.0:1736366559.439937:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a10e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013079168:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366559.439960:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366559.439969:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366559.439971:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366559.439974:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013079104:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366559.440016:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079040 00000100:00100000:2.0:1736366559.440047:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:2.0:1736366559.440051:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cac740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013079040:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366559.440095:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cac740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013079040:12345-0@lo:400:kworker/u8:0.0 Request processed in 43us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366559.440100:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:1.0:1736366559.440139:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013079040:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366559.625340:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366560.627394:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366561.629392:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366562.191427:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013079360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366562.191489:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366562.191560:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079360 00000100:00100000:0.0:1736366562.191610:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6016 00000100:00100000:0.0:1736366562.191617:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d64280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013079360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366562.191647:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366562.191693:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d64280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013079360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366562.191700:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6016 00000100:00100000:2.0:1736366562.191717:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013079360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366562.207415:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013079424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366562.207454:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366562.207481:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079424 00000100:00100000:0.0:1736366562.207514:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6017 00000100:00100000:0.0:1736366562.207519:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d66880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013079424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366562.207541:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366562.207595:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d66880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013079424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366562.207602:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6017 00000100:00100000:2.0:1736366562.207634:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009b13c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013079424:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366562.631429:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366563.633403:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366564.223938:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366564.223985:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366564.224024:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366564.224095:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030272 00000100:00100000:1.0:1736366564.224116:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030400 00000100:00100000:2.0:1736366564.224123:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030336 00000100:00100000:3.0:1736366564.224146:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 339 00000100:00100000:3.0:1736366564.224153:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041030272:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366564.224206:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 921 00000100:00100000:0.0:1736366564.224215:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a10e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041030400:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366564.224216:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1202 00000100:00100000:2.0:1736366564.224222:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a14740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041030336:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:2.0:1736366564.224238:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366564.224260:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a10e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041030400:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 47us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366564.224261:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041030272:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 107us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366564.224269:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 921 00000100:00100000:3.0:1736366564.224270:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 339 00000100:00100000:2.0:1736366564.224308:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a14740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041030336:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 85us (284us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366564.224316:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1202 00000100:00080000:0.0:1736366564.447339:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366564.447345:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366564.447348:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366564.447354:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8907 00000100:00080000:0.0:1736366564.447358:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366564.447363:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366564.447378:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a150c0 x1820703013079552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366564.447410:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366564.447413:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366564.447414:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366564.447417:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8907 00000100:00080000:0.0:1736366564.447419:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366564.447422:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366564.447430:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a12f80 x1820703013079680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366564.447442:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366564.447445:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366564.447446:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366564.447449:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8907 00000100:00100000:2.0:1736366564.447449:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a15f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013079488:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366564.447451:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1736366564.447453:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013079552:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366564.447454:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366564.447457:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013079616:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366564.447462:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a163c0 x1820703013079808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1736366564.447486:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366564.447500:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366564.447501:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366564.447504:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8907 00000100:00080000:0.0:1736366564.447506:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366564.447509:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366564.447511:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366564.447517:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366564.447518:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013079872:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366564.447519:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a104c0 x1820703013080000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366564.447543:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013079680:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366564.447553:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079552 00000100:00100000:2.0:1736366564.447557:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013079936:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366564.447559:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366564.447561:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366564.447578:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a163c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013079808:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366564.447584:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079680 00000100:00100000:2.0:1736366564.447594:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366564.447597:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366564.447599:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:1.0:1736366564.447600:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366564.447604:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013079552:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366564.447613:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013080000:0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366564.447614:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366564.447626:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1736366564.447630:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366564.447633:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013079744:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366564.447644:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079872 00000100:00100000:0.0:1736366564.447655:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013079552:12345-0@lo:38:kworker/u8:0.0 Request processed in 51us (145us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366564.447661:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366564.447661:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366564.447662:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00080000:1.0:1736366564.447666:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366564.447672:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013079552:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366564.447678:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079936 00000100:00100000:0.0:1736366564.447679:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079616 00000100:00100000:3.0:1736366564.447682:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079808 00000100:00100000:0.0:1736366564.447692:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080000 00000100:00100000:0.0:1736366564.447699:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079744 00000100:00100000:2.0:1736366564.447699:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7371 00000100:00100000:3.0:1736366564.447703:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77143 00000100:00100000:2.0:1736366564.447706:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c84c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013079872:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366564.447708:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013079808:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366564.447709:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:0.0:1736366564.447713:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013079616:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:3.0:1736366564.447718:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366564.447735:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7372 00000100:00100000:1.0:1736366564.447744:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d65f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013079936:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366564.447750:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013079616:12345-0@lo:400:kworker/u8:0.0 Request processed in 36us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366564.447752:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013079808:12345-0@lo:38:kworker/u8:0.0 Request processed in 44us (151us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366564.447756:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:3.0:1736366564.447759:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77143 00000100:00100000:0.0:1736366564.447766:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:2.0:1736366564.447768:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c84c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013079872:12345-0@lo:400:kworker/u8:0.0 Request processed in 62us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366564.447770:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013079744:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366564.447779:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7371 00000100:00100000:3.0:1736366564.447780:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:3.0:1736366564.447784:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b138980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013079680:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366564.447789:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366564.447791:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013079744:12345-0@lo:400:kworker/u8:0.0 Request processed in 21us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366564.447793:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d65f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013079936:12345-0@lo:400:kworker/u8:0.0 Request processed in 51us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366564.447800:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7372 00000100:00100000:0.0:1736366564.447805:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1736366564.447808:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b138980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013079680:12345-0@lo:38:kworker/u8:0.0 Request processed in 23us (247us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366564.447812:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1736366564.447816:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1736366564.447818:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013080000:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366564.447830:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366564.447848:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013079872:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366564.447857:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013079488 00000100:00080000:1.0:1736366564.447857:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366564.447860:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366564.447865:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a163c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013079808:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366564.447870:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013079744:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366564.447875:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1736366564.447878:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013079488:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366564.447879:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366564.447880:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013079616:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366564.447882:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366564.447884:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013080000:12345-0@lo:38:kworker/u8:0.0 Request processed in 64us (252us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366564.447886:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013079680:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366564.447895:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:0.0:1736366564.447904:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013079488:12345-0@lo:400:kworker/u8:0.0 Request processed in 26us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366564.447910:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:1.0:1736366564.447913:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366564.447916:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366564.447920:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013080000:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366564.447944:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013079936:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366564.447958:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a15f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013079488:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366564.635420:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366565.637415:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366566.639422:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366567.199489:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366567.199512:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013080064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366567.199575:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366567.199662:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080064 00000100:00100000:2.0:1736366567.199728:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6018 00000100:00100000:2.0:1736366567.199737:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a12140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013080064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366567.199774:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366567.199852:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a12140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013080064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366567.199865:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6018 00000100:00100000:0.0:1736366567.199883:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013080064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366567.215395:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736366567.215410:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013080128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1736366567.215451:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366567.215527:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080128 00000100:00100000:2.0:1736366567.215578:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6019 00000100:00100000:2.0:1736366567.215586:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013080128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366567.215616:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366567.215686:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013080128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366567.215698:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6019 00000100:00100000:3.0:1736366567.215717:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013080128:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366567.641413:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366568.643416:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366569.232074:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366569.232119:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366569.232218:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366569.232244:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030464 00000100:00100000:2.0:1736366569.232280:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030592 00000100:00100000:1.0:1736366569.232305:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 341 00000100:00100000:1.0:1736366569.232314:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041030464:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366569.232335:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030528 00000100:00100000:2.0:1736366569.232350:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 924 00000100:00100000:2.0:1736366569.232356:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a15580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041030592:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366569.232359:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1206 00000100:00100000:3.0:1736366569.232367:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a15f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041030528:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:3.0:1736366569.232387:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366569.232398:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041030464:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 84us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366569.232403:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a15580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041030592:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 47us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366569.232409:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 341 00000100:00100000:2.0:1736366569.232410:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 924 00000100:00100000:3.0:1736366569.232422:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a15f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041030528:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 55us (260us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366569.232431:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1206 00000100:00080000:0.0:1736366569.455347:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366569.455354:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366569.455357:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366569.455364:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8912 00000100:00080000:0.0:1736366569.455368:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366569.455374:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366569.455393:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a104c0 x1820703013080256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366569.455416:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013080192:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366569.455421:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366569.455424:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366569.455443:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366569.455447:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8912 00000100:00080000:0.0:1736366569.455449:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366569.455452:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366569.455456:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013080320:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366569.455463:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a163c0 x1820703013080384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366569.455484:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013080256:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366569.455486:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366569.455489:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366569.455490:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366569.455493:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8912 00000100:00080000:0.0:1736366569.455495:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:0.0:1736366569.455498:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366569.455498:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366569.455506:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880099a15a40 x1820703013080512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366569.455516:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1736366569.455524:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1736366569.455527:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1736366569.455528:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1736366569.455531:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8912 00000100:00080000:0.0:1736366569.455533:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1736366569.455535:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366569.455543:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88008a56d0c0 x1820703013080704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366569.455551:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013080640:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366569.455559:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080192 00000100:00100000:0.0:1736366569.455567:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013080576:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366569.455585:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080320 00000100:00100000:3.0:1736366569.455588:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366569.455605:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366569.455615:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1736366569.455615:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:2.0:1736366569.455620:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d62600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013080320:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366569.455623:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013080192:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366569.455627:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013080448:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366569.455654:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080640 00000100:00100000:3.0:1736366569.455662:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366569.455673:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d62600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013080320:12345-0@lo:400:kworker/u8:0.0 Request processed in 52us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366569.455679:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080576 00000100:00100000:2.0:1736366569.455680:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:1.0:1736366569.455681:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013080192:12345-0@lo:400:kworker/u8:0.0 Request processed in 58us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366569.455691:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1736366569.455697:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080448 00000100:00100000:0.0:1736366569.455706:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7373 00000100:00100000:0.0:1736366569.455711:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9caf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013080640:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366569.455711:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013080192:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366569.455712:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:2.0:1736366569.455715:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9ced40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013080448:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366569.455731:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7374 00000100:00100000:1.0:1736366569.455737:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013080576:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366569.455743:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9ced40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013080448:12345-0@lo:400:kworker/u8:0.0 Request processed in 27us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366569.455748:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:3.0:1736366569.455768:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a11300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013080448:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366569.455769:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9caf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013080640:12345-0@lo:400:kworker/u8:0.0 Request processed in 58us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366569.455776:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7373 00000100:00100000:2.0:1736366569.455778:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a12f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013080320:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366569.455784:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013080576:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366569.455794:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7374 00000100:00100000:3.0:1736366569.455798:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013080640:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366569.455819:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a13900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013080576:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366569.455824:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366569.455854:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080256 00000100:00100000:1.0:1736366569.455862:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a163c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013080384:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366569.455878:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1736366569.455882:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013080256:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366569.455893:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:0.0:1736366569.455895:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366569.455924:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013080256:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (101us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366569.455930:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1736366569.455931:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080384 00000100:00100000:1.0:1736366569.455936:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013080512:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366569.455952:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1736366569.455956:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013080384:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366569.455966:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366569.455969:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366569.455999:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013080384:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (108us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366569.456001:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013080704:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366569.456006:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:1.0:1736366569.456028:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366569.456029:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080512 00000100:00100000:2.0:1736366569.456046:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080704 00000100:00100000:0.0:1736366569.456052:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77144 00000100:00080000:1.0:1736366569.456053:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366569.456056:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b13c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013080512:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366569.456058:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366569.456060:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:1.0:1736366569.456064:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a104c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013080256:0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366569.456065:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366569.456065:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a05580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013080704:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366569.456072:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736366569.456077:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366569.456080:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366569.456084:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a163c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013080384:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366569.456091:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b13c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013080512:12345-0@lo:38:kworker/u8:0.0 Request processed in 35us (124us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366569.456096:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a05580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013080704:12345-0@lo:38:kworker/u8:0.0 Request processed in 32us (69us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366569.456097:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77144 00000100:00080000:1.0:1736366569.456113:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366569.456119:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00080000:1.0:1736366569.456125:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366569.456129:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013080512:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366569.456143:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366569.456146:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366569.456149:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013080704:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366569.645402:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366570.647462:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366571.649496:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366572.207413:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736366572.207439:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013080768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366572.207509:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366572.207577:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080768 00000100:00100000:2.0:1736366572.207640:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6020 00000100:00100000:2.0:1736366572.207647:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9ce3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013080768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366572.207679:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366572.207743:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9ce3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013080768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366572.207751:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6020 00000100:00100000:3.0:1736366572.207790:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013080768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366572.223437:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013080832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366572.223478:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366572.223532:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080832 00000100:00100000:2.0:1736366572.223576:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6021 00000100:00100000:2.0:1736366572.223581:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013080832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366572.223604:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366572.223647:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013080832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366572.223654:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6021 00000100:00100000:0.0:1736366572.223665:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013080832:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366572.651408:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366573.653437:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366574.240238:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366574.240286:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366574.240326:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366574.240359:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030784 00000100:00100000:1.0:1736366574.240360:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030656 00000100:00100000:3.0:1736366574.240364:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030720 00000100:00100000:1.0:1736366574.240412:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 343 00000100:00100000:1.0:1736366574.240422:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041030656:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1736366574.240425:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 927 00000100:00100000:3.0:1736366574.240432:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041030784:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366574.240434:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1210 00000100:00100000:0.0:1736366574.240439:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041030720:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:0.0:1736366574.240456:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366574.240508:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041030720:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 68us (182us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366574.240509:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041030656:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 87us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366574.240509:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041030784:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366574.240516:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1210 00000100:00100000:1.0:1736366574.240521:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 343 00000100:00100000:3.0:1736366574.240521:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 927 00000100:00080000:2.0:1736366574.463411:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366574.463417:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366574.463420:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366574.463426:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8917 00000100:00080000:2.0:1736366574.463429:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366574.463435:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366574.463442:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013080896:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366574.463455:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d63440 x1820703013080960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366574.463488:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013080960:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366574.463494:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736366574.463500:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366574.463508:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366574.463510:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366574.463513:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8917 00000100:00080000:2.0:1736366574.463515:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366574.463519:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366574.463530:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880095d61300 x1820703013081088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366574.463537:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013081024:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366574.463544:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366574.463546:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366574.463548:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366574.463549:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736366574.463551:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080896 00000100:00080000:2.0:1736366574.463552:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8917 00000100:00080000:2.0:1736366574.463554:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366574.463557:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366574.463567:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc304c0 x1820703013081216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366574.463576:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366574.463580:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013081088:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366574.463582:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1736366574.463587:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013080896:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366574.463592:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366574.463595:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366574.463596:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366574.463599:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8917 00000100:00100000:3.0:1736366574.463599:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1736366574.463600:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366574.463602:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366574.463608:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366574.463608:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013081152:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366574.463610:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc31c80 x1820703013081408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366574.463627:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013080896:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366574.463628:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc304c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013081216:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366574.463635:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1736366574.463637:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366574.463656:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366574.463656:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013080960 00000100:00100000:3.0:1736366574.463670:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081024 00000100:00100000:0.0:1736366574.463675:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081216 00000100:00100000:1.0:1736366574.463678:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc31c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013081408:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366574.463681:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081088 00000100:00100000:0.0:1736366574.463691:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77145 00000100:00100000:2.0:1736366574.463692:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081152 00000100:00100000:0.0:1736366574.463694:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a00980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013081216:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366574.463702:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1736366574.463704:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:0.0:1736366574.463706:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366574.463710:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9ce880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013081024:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366574.463715:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081408 00000100:00100000:2.0:1736366574.463726:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:2.0:1736366574.463730:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013081152:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366574.463732:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a00980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013081216:12345-0@lo:38:kworker/u8:0.0 Request processed in 36us (77us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366574.463734:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:0.0:1736366574.463738:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77145 00000100:00100000:1.0:1736366574.463741:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013080960:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366574.463755:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366574.463756:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:0.0:1736366574.463760:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a01c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013081088:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366574.463765:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9ce880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013081024:12345-0@lo:400:kworker/u8:0.0 Request processed in 56us (190us total) trans 0 rc 0/0 00010000:02000000:0.0:1736366574.463767:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366574.463775:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:2.0:1736366574.463778:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013081152:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366574.463785:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1736366574.463788:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a01c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013081088:12345-0@lo:38:kworker/u8:0.0 Request processed in 27us (182us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366574.463796:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:3.0:1736366574.463801:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a017c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013081408:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366574.463803:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013080960:12345-0@lo:38:kworker/u8:0.0 Request processed in 62us (260us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366574.463807:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:1.0:1736366574.463812:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00010000:02000000:3.0:1736366574.463812:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366574.463829:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc36880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013081344:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366574.463838:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a017c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013081408:12345-0@lo:38:kworker/u8:0.0 Request processed in 35us (134us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366574.463839:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc33900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013081280:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366574.463847:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:0.0:1736366574.463857:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366574.463883:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013080896:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366574.463886:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013081152:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366574.463888:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366574.463901:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013081024:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366574.463908:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081344 00000100:00100000:0.0:1736366574.463926:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081280 00000100:00080000:1.0:1736366574.463934:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366574.463938:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366574.463943:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc31c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013081408:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366574.463955:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7375 00000100:00080000:1.0:1736366574.463955:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366574.463959:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013081344:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366574.463959:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366574.463963:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013081088:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366574.463971:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7376 00000100:00080000:1.0:1736366574.463974:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366574.463976:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366574.463978:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a02ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013081280:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366574.463980:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc304c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013081216:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366574.463991:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366574.463992:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013081344:12345-0@lo:400:kworker/u8:0.0 Request processed in 33us (136us total) trans 0 rc 0/0 00000100:00080000:1.0:1736366574.463994:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366574.463997:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013080960:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366574.463998:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7375 00000100:00100000:0.0:1736366574.464024:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc36880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013081344:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366574.464039:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a02ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013081280:12345-0@lo:400:kworker/u8:0.0 Request processed in 61us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366574.464045:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc33900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013081280:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366574.464050:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7376 00010000:00010000:3.0:1736366574.655411:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366575.657506:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366576.659458:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366577.215444:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9c8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013081472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366577.215514:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366577.215581:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081472 00000100:00100000:2.0:1736366577.215644:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6022 00000100:00100000:2.0:1736366577.215650:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013081472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366577.215682:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366577.215738:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013081472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366577.215746:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6022 00000100:00100000:0.0:1736366577.215765:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9c8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013081472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366577.231384:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736366577.231402:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013081536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366577.231443:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366577.231496:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081536 00000100:00100000:2.0:1736366577.231543:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6023 00000100:00100000:2.0:1736366577.231548:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a04740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013081536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366577.231572:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366577.231625:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a04740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013081536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366577.231632:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6023 00000100:00100000:1.0:1736366577.231665:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013081536:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366577.661402:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366578.663406:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366579.248076:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366579.248125:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366579.248194:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366579.248211:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030976 00000100:00100000:0.0:1736366579.248231:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030912 00000100:00100000:1.0:1736366579.248246:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041030848 00000100:00100000:0.0:1736366579.248259:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 930 00000100:00100000:0.0:1736366579.248266:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041030976:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366579.248285:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1214 00000100:00100000:1.0:1736366579.248286:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 345 00000100:00100000:2.0:1736366579.248291:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041030912:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:1.0:1736366579.248292:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041030848:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:2.0:1736366579.248309:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366579.248333:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041030976:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 67us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366579.248338:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041030848:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 45us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366579.248345:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 345 00000100:00100000:0.0:1736366579.248355:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 930 00000100:00100000:2.0:1736366579.248359:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041030912:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 68us (165us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366579.248377:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1214 00000100:00080000:2.0:1736366579.471320:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366579.471327:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366579.471330:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366579.471335:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8922 00000100:00080000:2.0:1736366579.471339:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366579.471344:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366579.471361:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc36880 x1820703013081664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366579.471381:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366579.471384:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366579.471385:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366579.471388:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8922 00000100:00080000:2.0:1736366579.471390:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366579.471393:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366579.471400:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012cc31c80 x1820703013081792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366579.471426:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc33900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013081600:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366579.471429:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366579.471431:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc304c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013081728:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366579.471432:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366579.471434:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366579.471436:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8922 00000100:00080000:2.0:1736366579.471438:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736366579.471441:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366579.471451:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013693b440 x1820703013081920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366579.471478:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366579.471479:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366579.471482:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366579.471485:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366579.471486:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366579.471490:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8922 00000100:00080000:2.0:1736366579.471491:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366579.471494:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366579.471502:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880136939c80 x1820703013082112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366579.471507:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013693f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013082048:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366579.471518:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc36880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013081664:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366579.471521:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136938980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013081856:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366579.471527:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013693df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013081984:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366579.471533:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366579.471555:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366579.471564:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081600 00000100:00100000:1.0:1736366579.471571:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc31c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013081792:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366579.471576:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366579.471578:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366579.471589:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1736366579.471594:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013081600:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366579.471602:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366579.471613:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013693b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013081920:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366579.471618:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081728 00000100:00100000:0.0:1736366579.471627:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013081600:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366579.471627:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082048 00000100:00100000:0.0:1736366579.471634:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1736366579.471635:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366579.471641:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081664 00000100:00100000:1.0:1736366579.471645:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136939c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013082112:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366579.471654:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081856 00000100:00100000:3.0:1736366579.471654:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081984 00000100:00100000:1.0:1736366579.471661:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366579.471662:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081792 00000100:00100000:2.0:1736366579.471664:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082112 00000100:00100000:3.0:1736366579.471668:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7377 00000100:00100000:3.0:1736366579.471674:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fa07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013082048:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366579.471675:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:2.0:1736366579.471679:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a06880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013081728:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366579.471687:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:0.0:1736366579.471691:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cf6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013081856:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366579.471692:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:1.0:1736366579.471697:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a063c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013081664:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366579.471708:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366579.471716:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fa07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013082048:12345-0@lo:400:kworker/u8:0.0 Request processed in 43us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366579.471721:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a06880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013081728:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366579.471723:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7377 00000100:00100000:0.0:1736366579.471729:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cf6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013081856:12345-0@lo:400:kworker/u8:0.0 Request processed in 37us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366579.471729:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:0.0:1736366579.471736:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1736366579.471737:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a063c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013081664:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (181us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366579.471744:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1736366579.471747:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:0.0:1736366579.471752:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:2.0:1736366579.471752:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a02140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013081792:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366579.471756:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a050c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013082112:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366579.471761:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1736366579.471766:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736366579.471772:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366579.471775:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366579.471779:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc36880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013081664:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366579.471783:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a02140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013081792:12345-0@lo:38:kworker/u8:0.0 Request processed in 31us (181us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366579.471787:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a050c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013082112:12345-0@lo:38:kworker/u8:0.0 Request processed in 30us (126us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366579.471789:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:0.0:1736366579.471793:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00080000:1.0:1736366579.471801:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366579.471804:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366579.471806:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc31c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013081792:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366579.471811:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7378 00000100:00080000:1.0:1736366579.471814:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366579.471814:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013081920 00000100:00080000:1.0:1736366579.471816:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366579.471818:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136939c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013082112:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366579.471825:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369397c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013081984:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366579.471840:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77146 00000100:00100000:2.0:1736366579.471844:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a02f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013081920:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366579.471851:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc304c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013081728:0@lo:400:kworker/u8:0.0 00010000:02000000:2.0:1736366579.471851:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366579.471857:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369397c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013081984:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366579.471862:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7378 00000100:00100000:2.0:1736366579.471878:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a02f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013081920:12345-0@lo:38:kworker/u8:0.0 Request processed in 34us (243us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366579.471883:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77146 00000100:00100000:0.0:1736366579.471892:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136938980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013081856:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366579.471893:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366579.471895:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366579.471898:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013693b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013081920:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366579.471911:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013693df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013081984:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366579.471920:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013693f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013082048:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366579.471927:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc33900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013081600:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366579.665382:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366580.667396:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366581.669391:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366582.223444:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a5697c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013082176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366582.223514:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366582.223586:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082176 00000100:00100000:0.0:1736366582.223640:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6024 00000100:00100000:0.0:1736366582.223647:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a076c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013082176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366582.223678:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366582.223736:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a076c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013082176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366582.223744:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6024 00000100:00100000:1.0:1736366582.223785:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a5697c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013082176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366582.239383:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073a07200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013082240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366582.239424:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366582.239479:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082240 00000100:00100000:2.0:1736366582.239530:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6025 00000100:00100000:2.0:1736366582.239535:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013082240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366582.239558:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366582.239605:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013082240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366582.239612:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6025 00000100:00100000:0.0:1736366582.239624:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073a07200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013082240:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366582.671383:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366583.673403:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366584.256125:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366584.256204:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366584.256220:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031168 00000100:00100000:0.0:1736366584.256258:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366584.256282:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031104 00000100:00100000:2.0:1736366584.256290:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031040 00000100:00100000:1.0:1736366584.256311:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 933 00000100:00100000:1.0:1736366584.256320:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041031168:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366584.256323:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1218 00000100:00100000:0.0:1736366584.256332:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a5684c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041031104:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:2.0:1736366584.256332:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 347 00000100:00100000:2.0:1736366584.256339:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041031040:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:0.0:1736366584.256353:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366584.256406:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041031168:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 86us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366584.256406:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041031040:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 65us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366584.256413:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a5684c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041031104:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 81us (156us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366584.256418:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 347 00000100:00100000:1.0:1736366584.256419:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 933 00000100:00100000:0.0:1736366584.256425:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1218 00000100:00080000:2.0:1736366584.479320:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366584.479328:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366584.479332:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366584.479339:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8927 00000100:00080000:2.0:1736366584.479355:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736366584.479362:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366584.479373:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013693df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013082304:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366584.479388:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013693f6c0 x1820703013082368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366584.479425:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366584.479442:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013693f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013082368:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366584.479446:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366584.479451:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366584.479453:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366584.479459:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8927 00000100:00080000:2.0:1736366584.479461:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736366584.479466:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366584.479479:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136938980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013082432:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366584.479480:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013693b440 x1820703013082496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366584.479501:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366584.479505:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1736366584.479505:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082304 00000100:00080000:2.0:1736366584.479507:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366584.479511:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8927 00000100:00100000:1.0:1736366584.479513:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366584.479514:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736366584.479518:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366584.479532:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880136939300 x1820703013082624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366584.479542:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136938e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013082560:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366584.479543:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1736366584.479550:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013082304:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366584.479569:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366584.479571:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013693b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013082496:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366584.479573:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366584.479575:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736366584.479576:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366584.479579:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8927 00000100:00080000:2.0:1736366584.479582:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736366584.479595:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366584.479603:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013082304:12345-0@lo:400:kworker/u8:0.0 Request processed in 53us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366584.479604:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366584.479613:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880136939c80 x1820703013082816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366584.479613:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1736366584.479616:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082368 00000100:00100000:1.0:1736366584.479620:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136939300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013082624:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366584.479641:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082560 00000100:00100000:2.0:1736366584.479644:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013693d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013082688:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366584.479649:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366584.479661:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082496 00000100:00100000:0.0:1736366584.479668:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:1.0:1736366584.479671:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136939c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013082816:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366584.479676:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a569c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013082560:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366584.479685:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366584.479700:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1736366584.479701:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366584.479706:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013082368:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366584.479712:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:02000000:3.0:1736366584.479720:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366584.479721:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013693ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013082752:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366584.479723:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a569c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013082560:12345-0@lo:400:kworker/u8:0.0 Request processed in 47us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366584.479729:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366584.479732:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:2.0:1736366584.479753:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366584.479756:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082816 00000100:00100000:1.0:1736366584.479760:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082432 00000100:00100000:0.0:1736366584.479770:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1736366584.479774:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013082368:12345-0@lo:38:kworker/u8:0.0 Request processed in 66us (262us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366584.479776:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a03900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013082496:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366584.479784:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:2.0:1736366584.479787:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082624 00000100:00100000:3.0:1736366584.479789:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00010000:02000000:0.0:1736366584.479790:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366584.479790:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a03440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013082432:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366584.479811:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:2.0:1736366584.479813:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77147 00000100:00100000:3.0:1736366584.479816:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a00e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013082816:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366584.479818:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a03dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013082624:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366584.479826:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a03900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013082496:12345-0@lo:38:kworker/u8:0.0 Request processed in 50us (224us total) trans 0 rc -19/-19 00010000:02000000:3.0:1736366584.479828:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366584.479830:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366584.479835:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:1.0:1736366584.479837:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a03440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013082432:12345-0@lo:400:kworker/u8:0.0 Request processed in 47us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366584.479846:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1736366584.479854:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a00e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013082816:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (155us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366584.479862:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a03dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013082624:12345-0@lo:38:kworker/u8:0.0 Request processed in 42us (213us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366584.479862:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:2.0:1736366584.479870:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77147 00000100:00100000:1.0:1736366584.479873:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082688 00000100:00100000:0.0:1736366584.479883:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136938e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013082560:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366584.479888:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082752 00000100:00100000:1.0:1736366584.479900:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7379 00000100:00100000:1.0:1736366584.479905:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013082688:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366584.479915:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013693df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013082304:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366584.479917:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7380 00000100:00100000:3.0:1736366584.479922:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013082752:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366584.479983:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013082688:12345-0@lo:400:kworker/u8:0.0 Request processed in 75us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366584.479988:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013082752:12345-0@lo:400:kworker/u8:0.0 Request processed in 65us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366584.479993:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7379 00000100:00100000:3.0:1736366584.479996:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7380 00000100:00100000:1.0:1736366584.480033:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136938980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013082432:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366584.480055:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013693ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013082752:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366584.480067:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366584.480068:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013693d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013082688:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366584.480072:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366584.480077:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136939c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013082816:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366584.480100:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366584.480102:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366584.480105:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013693b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013082496:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366584.480113:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366584.480115:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366584.480117:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136939300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013082624:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366584.480124:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366584.480126:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366584.480128:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013693f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013082368:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366584.675383:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366585.677351:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366586.679355:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366587.231456:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880073a01300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013082880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366587.231538:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366587.231624:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082880 00000100:00100000:0.0:1736366587.231708:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6026 00000100:00100000:0.0:1736366587.231717:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013082880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366587.231756:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366587.231820:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013082880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366587.231830:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6026 00000100:00100000:2.0:1736366587.231852:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880073a01300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013082880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366587.247361:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013082944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366587.247407:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366587.247485:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013082944 00000100:00100000:0.0:1736366587.247519:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6027 00000100:00100000:0.0:1736366587.247527:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1729300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013082944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366587.247558:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366587.247617:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1729300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013082944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366587.247628:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6027 00000100:00100000:2.0:1736366587.247671:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013082944:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366587.681402:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366588.683395:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366589.263935:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366589.263979:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366589.264017:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366589.264024:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031232 00000100:00100000:1.0:1736366589.264057:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031360 00000100:00100000:3.0:1736366589.264080:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 349 00000100:00100000:3.0:1736366589.264090:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041031232:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366589.264107:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031296 00000100:00100000:2.0:1736366589.264122:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 936 00000100:00100000:2.0:1736366589.264134:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a568980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041031360:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366589.264144:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1222 00000100:00100000:1.0:1736366589.264151:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041031296:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366589.264197:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041031232:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 107us (265us total) trans 0 rc 0/0 00010000:02000000:1.0:1736366589.264204:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366589.264209:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 349 00000100:00100000:2.0:1736366589.264245:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a568980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041031360:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 112us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366589.264248:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041031296:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 96us (230us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366589.264257:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 936 00000100:00100000:1.0:1736366589.264273:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1222 00000100:00080000:2.0:1736366589.487369:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366589.487378:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366589.487382:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366589.487389:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8932 00000100:00080000:2.0:1736366589.487394:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736366589.487401:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366589.487422:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013083008:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366589.487426:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a17284c0 x1820703013083072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366589.487455:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366589.487460:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366589.487462:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366589.487466:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8932 00000100:00080000:2.0:1736366589.487469:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736366589.487473:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366589.487475:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366589.487476:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013083136:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366589.487488:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172f200 x1820703013083200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366589.487517:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366589.487522:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1736366589.487530:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366589.487535:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736366589.487540:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17284c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013083072:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366589.487540:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8932 00000100:00080000:2.0:1736366589.487543:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366589.487547:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366589.487559:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083008 00000100:00100000:2.0:1736366589.487564:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a1729c80 x1820703013083328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366589.487576:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366589.487577:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083136 00000100:00100000:0.0:1736366589.487594:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013083200:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366589.487594:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00080000:2.0:1736366589.487600:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736366589.487601:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013083008:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366589.487603:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083072 00000100:00080000:2.0:1736366589.487604:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366589.487606:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366589.487611:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8932 00000100:00080000:2.0:1736366589.487614:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00100000:0.0:1736366589.487617:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366589.487617:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366589.487623:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:1.0:1736366589.487628:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a04c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013083136:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366589.487630:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172d580 x1820703013083520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366589.487636:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1729c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013083328:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366589.487660:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013083392:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366589.487667:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366589.487671:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013083008:12345-0@lo:400:kworker/u8:0.0 Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366589.487682:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1736366589.487684:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a04c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013083136:12345-0@lo:400:kworker/u8:0.0 Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366589.487691:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013083520:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366589.487692:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:2.0:1736366589.487697:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366589.487708:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083200 00000100:00100000:1.0:1736366589.487727:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:3.0:1736366589.487727:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013083264:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366589.487731:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366589.487733:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a568e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013083072:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366589.487741:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083328 00010000:02000000:1.0:1736366589.487744:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366589.487757:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083520 00000100:00100000:3.0:1736366589.487762:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366589.487769:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77148 00000100:00100000:0.0:1736366589.487773:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083264 00000100:00100000:2.0:1736366589.487775:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013083328:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366589.487776:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a568e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013083072:12345-0@lo:38:kworker/u8:0.0 Request processed in 43us (201us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366589.487786:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00010000:02000000:2.0:1736366589.487789:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366589.487803:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:0.0:1736366589.487810:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1736366589.487810:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013083264:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366589.487814:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083392 00000100:00100000:0.0:1736366589.487817:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a569300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013083200:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366589.487826:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013083328:12345-0@lo:38:kworker/u8:0.0 Request processed in 50us (159us total) trans 0 rc -19/-19 00010000:02000000:0.0:1736366589.487828:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366589.487835:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77148 00000100:00100000:3.0:1736366589.487845:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7381 00000100:00100000:3.0:1736366589.487851:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013083392:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366589.487852:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013083264:12345-0@lo:400:kworker/u8:0.0 Request processed in 43us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366589.487901:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00100000:0.0:1736366589.487908:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a569300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013083200:12345-0@lo:38:kworker/u8:0.0 Request processed in 89us (289us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366589.487919:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1736366589.487928:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:1.0:1736366589.487935:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013083520:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366589.487940:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013083392:12345-0@lo:400:kworker/u8:0.0 Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366589.487945:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013083456:0@lo:400:kworker/u8:0.0 00010000:02000000:1.0:1736366589.487946:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366589.487948:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7381 00000100:00100000:2.0:1736366589.487968:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013083392:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366589.487986:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013083264:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366589.487991:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013083520:12345-0@lo:38:kworker/u8:0.0 Request processed in 56us (261us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366589.487999:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366589.488002:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1736366589.488019:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083456 00000100:00100000:0.0:1736366589.488028:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013083008:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366589.488038:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013083136:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366589.488059:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7382 00000100:00080000:0.0:1736366589.488062:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366589.488064:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013083456:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366589.488066:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366589.488071:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013083520:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366589.488083:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366589.488086:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366589.488090:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1729c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013083328:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366589.488101:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366589.488104:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366589.488107:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17284c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013083072:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366589.488118:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366589.488121:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366589.488123:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013083200:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366589.488129:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013083456:12345-0@lo:400:kworker/u8:0.0 Request processed in 62us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366589.488139:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7382 00000100:00100000:1.0:1736366589.488220:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013083456:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366589.685407:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366590.687353:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366591.689367:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366592.239423:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1736366592.239444:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013083584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366592.239522:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366592.239587:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083584 00000100:00100000:0.0:1736366592.239647:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6028 00000100:00100000:0.0:1736366592.239656:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a06d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013083584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366592.239693:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366592.239762:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a06d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013083584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366592.239771:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6028 00000100:00100000:1.0:1736366592.239839:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013083584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366592.255366:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366592.255381:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013083648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366592.255420:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366592.255489:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083648 00000100:00100000:2.0:1736366592.255536:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6029 00000100:00100000:2.0:1736366592.255543:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013083648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366592.255571:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366592.255621:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013083648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366592.255631:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6029 00000100:00100000:0.0:1736366592.255643:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013083648:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366592.691415:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366593.693428:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366594.272010:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366594.272079:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366594.272117:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031552 00000100:00100000:0.0:1736366594.272138:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366594.272208:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031424 00000100:00100000:2.0:1736366594.272214:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031488 00000100:00100000:0.0:1736366594.272228:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 939 00000100:00100000:0.0:1736366594.272239:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a5697c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041031552:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366594.272253:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1226 00000100:00100000:2.0:1736366594.272259:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041031488:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366594.272260:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 351 00000100:00100000:3.0:1736366594.272269:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041031424:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:2.0:1736366594.272277:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366594.272321:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041031488:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 61us (184us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366594.272325:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a5697c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041031552:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 89us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366594.272328:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041031424:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 59us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366594.272333:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1226 00000100:00100000:0.0:1736366594.272338:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 939 00000100:00100000:3.0:1736366594.272360:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 351 00000100:00080000:2.0:1736366594.495328:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366594.495336:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366594.495340:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366594.495348:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8937 00000100:00080000:2.0:1736366594.495353:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366594.495361:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366594.495385:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013083712:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366594.495386:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172aac0 x1820703013083776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366594.495442:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736366594.495446:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366594.495447:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366594.495449:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366594.495466:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8937 00000100:00080000:2.0:1736366594.495469:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366594.495474:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366594.495482:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013083776:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366594.495492:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a1728e40 x1820703013083904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366594.495507:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1736366594.495513:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083712 00000100:00080000:2.0:1736366594.495515:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736366594.495518:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013083968:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366594.495519:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366594.495521:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366594.495525:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8937 00000100:00080000:2.0:1736366594.495527:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366594.495531:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366594.495542:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366594.495545:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172af80 x1820703013084032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366594.495556:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1736366594.495563:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013083712:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366594.495580:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366594.495584:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366594.495586:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1736366594.495588:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083776 00000100:00080000:2.0:1736366594.495590:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8937 00000100:00080000:2.0:1736366594.495593:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366594.495597:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366594.495607:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1728e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013083904:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366594.495610:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172c740 x1820703013084224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366594.495610:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3326:x1820703013083712:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366594.495621:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1736366594.495623:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:0.0:1736366594.495629:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a02600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013083776:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366594.495638:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:0.0:1736366594.495644:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366594.495645:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013084096:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366594.495657:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013084032:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366594.495684:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366594.495687:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a02600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013083776:12345-0@lo:38:kworker/u8:0.0 Request processed in 58us (147us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366594.495694:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366594.495697:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:2.0:1736366594.495715:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1736366594.495718:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084096 00000100:00100000:2.0:1736366594.495722:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013084160:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366594.495724:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083904 00000100:00080000:1.0:1736366594.495729:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366594.495734:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366594.495739:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013083776:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366594.495744:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:0.0:1736366594.495749:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a004c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013083904:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366594.495750:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7383 00000100:00100000:3.0:1736366594.495756:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013084096:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:0.0:1736366594.495759:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366594.495762:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013084224:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366594.495765:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366594.495831:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a004c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013083904:12345-0@lo:38:kworker/u8:0.0 Request processed in 80us (193us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366594.495837:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366594.495841:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:2.0:1736366594.495843:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084032 00000100:00100000:3.0:1736366594.495858:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013084096:12345-0@lo:400:kworker/u8:0.0 Request processed in 101us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366594.495860:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084224 00000100:00080000:1.0:1736366594.495864:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366594.495868:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366594.495868:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7383 00000100:00100000:2.0:1736366594.495869:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77149 00000100:00100000:1.0:1736366594.495873:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1728e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013083904:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366594.495875:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a01300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013084032:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366594.495878:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:0.0:1736366594.495882:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a07200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013084224:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366594.495886:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366594.495889:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084160 00010000:02000000:0.0:1736366594.495890:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366594.495913:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366594.495913:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7384 00000100:00100000:3.0:1736366594.495918:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013084160:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366594.495925:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a07200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013084224:12345-0@lo:38:kworker/u8:0.0 Request processed in 40us (88us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366594.495933:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013083840:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366594.495934:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:2.0:1736366594.495935:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a01300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013084032:12345-0@lo:38:kworker/u8:0.0 Request processed in 61us (242us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366594.495944:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77149 00000100:00100000:0.0:1736366594.495949:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083968 00000100:00100000:3.0:1736366594.495957:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013084160:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366594.495960:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366594.495966:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7384 00000100:00100000:2.0:1736366594.495981:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013083840 00000100:00100000:0.0:1736366594.495991:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:0.0:1736366594.495996:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a05f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013083968:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366594.496004:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:1.0:1736366594.496011:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880073a02ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013083840:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366594.496038:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013084160:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366594.496049:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a05f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013083968:12345-0@lo:400:kworker/u8:0.0 Request processed in 52us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366594.496054:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013084096:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366594.496057:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880073a02ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013083840:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366594.496058:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00100000:1.0:1736366594.496077:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1736366594.496095:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013083968:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366594.496117:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366594.496121:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366594.496123:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013083840:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366594.496126:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013084224:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366594.496141:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366594.496143:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366594.496145:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013084032:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366594.496192:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3326:1820703013083712:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366594.695405:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366595.697439:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366596.699358:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366597.247393:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc33900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013084288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366597.247471:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366597.247552:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084288 00000100:00100000:2.0:1736366597.247619:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6030 00000100:00100000:2.0:1736366597.247628:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cb900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013084288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366597.247667:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366597.247799:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cb900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013084288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 171us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366597.247806:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc33900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013084288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366597.247809:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6030 00000100:00100000:2.0:1736366597.263360:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013084352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366597.263409:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366597.263479:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084352 00000100:00100000:0.0:1736366597.263532:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6031 00000100:00100000:0.0:1736366597.263540:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013084352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366597.263569:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366597.263615:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013084352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366597.263626:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6031 00000100:00100000:2.0:1736366597.263639:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008a56f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013084352:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366597.701400:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366598.703404:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366599.279925:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366599.279969:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366599.280008:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366599.280023:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031616 00000100:00100000:0.0:1736366599.280043:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031744 00000100:00100000:1.0:1736366599.280046:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031680 00000100:00100000:1.0:1736366599.280086:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 942 00000100:00100000:3.0:1736366599.280092:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 353 00000100:00100000:1.0:1736366599.280096:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041031744:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366599.280098:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1230 00000100:00100000:3.0:1736366599.280099:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041031616:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366599.280103:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041031680:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:0.0:1736366599.280121:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:0.0:1736366599.280200:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:1873:x1820703041031680:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 96us (192us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366599.280208:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1230 00000100:00100000:3.0:1736366599.280221:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041031616:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 119us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366599.280224:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041031744:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 129us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366599.280233:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 353 00000100:00100000:1.0:1736366599.280234:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 942 00000100:00080000:2.0:1736366599.503275:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366599.503282:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366599.503295:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366599.503301:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8942 00000100:00080000:2.0:1736366599.503305:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366599.503309:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366599.503328:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172c280 x1820703013084480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366599.503350:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366599.503353:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366599.503354:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366599.503357:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8942 00000100:00080000:2.0:1736366599.503358:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366599.503361:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366599.503369:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a17284c0 x1820703013084608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366599.503380:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013084416:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366599.503389:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013084544:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366599.503397:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366599.503400:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366599.503401:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366599.503403:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8942 00000100:00080000:2.0:1736366599.503405:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366599.503408:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366599.503416:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172d580 x1820703013084736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366599.503429:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366599.503435:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366599.503438:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366599.503439:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366599.503442:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8942 00000100:00100000:1.0:1736366599.503448:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366599.503449:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1736366599.503450:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1729c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013084672:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366599.503452:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366599.503457:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013084864:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366599.503462:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172e880 x1820703013084928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1736366599.503486:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013084800:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366599.503487:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366599.503491:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366599.503496:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013084480:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366599.503518:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084864 00000100:00100000:1.0:1736366599.503530:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366599.503533:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084416 00000100:00100000:2.0:1736366599.503534:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366599.503548:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17284c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013084608:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366599.503558:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084800 00000100:00100000:3.0:1736366599.503567:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1736366599.503573:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7385 00000100:00100000:3.0:1736366599.503574:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013084416:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366599.503576:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366599.503578:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013084864:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366599.503591:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013084736:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366599.503596:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084544 00000100:00100000:2.0:1736366599.503620:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084672 00000100:00100000:1.0:1736366599.503622:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366599.503623:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013084416:12345-0@lo:400:kworker/u8:0.0 Request processed in 49us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366599.503629:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013084864:12345-0@lo:400:kworker/u8:0.0 Request processed in 51us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366599.503631:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084480 00000100:00100000:3.0:1736366599.503633:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1736366599.503636:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7385 00000100:00100000:2.0:1736366599.503639:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084608 00000100:00100000:1.0:1736366599.503640:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013084928:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366599.503648:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1736366599.503654:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7386 00000100:00100000:2.0:1736366599.503654:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc31300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013084544:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366599.503658:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013084800:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366599.503681:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:1.0:1736366599.503683:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366599.503723:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013084672:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366599.503725:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013084800:12345-0@lo:400:kworker/u8:0.0 Request processed in 30us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366599.503731:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7386 00000100:00100000:2.0:1736366599.503732:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc31300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013084544:12345-0@lo:400:kworker/u8:0.0 Request processed in 78us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366599.503739:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1736366599.503752:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084928 00000100:00100000:1.0:1736366599.503754:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084736 00000100:00100000:2.0:1736366599.503754:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:2.0:1736366599.503757:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc317c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013084480:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366599.503764:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1736366599.503768:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc32140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013084608:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366599.503769:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366599.503774:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013084672:12345-0@lo:400:kworker/u8:0.0 Request processed in 85us (282us total) trans 0 rc 0/0 00010000:02000000:0.0:1736366599.503778:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366599.503781:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77150 00000100:00100000:3.0:1736366599.503783:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:1.0:1736366599.503787:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc32f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013084736:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366599.503799:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc317c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013084480:12345-0@lo:38:kworker/u8:0.0 Request processed in 40us (269us total) trans 0 rc -19/-19 00010000:02000000:1.0:1736366599.503800:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366599.503803:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1736366599.503806:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc32140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013084608:12345-0@lo:38:kworker/u8:0.0 Request processed in 37us (231us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366599.503809:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc33440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013084928:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366599.503815:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:0.0:1736366599.503819:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00010000:02000000:3.0:1736366599.503819:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366599.503833:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc32f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013084736:12345-0@lo:38:kworker/u8:0.0 Request processed in 45us (211us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366599.503840:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc33440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013084928:12345-0@lo:38:kworker/u8:0.0 Request processed in 31us (159us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366599.503843:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77150 00000100:00100000:3.0:1736366599.503849:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1736366599.503856:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013084800:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366599.503863:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013084864:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366599.503872:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013084416:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366599.503886:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013084544:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366599.503895:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1729c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013084672:0@lo:400:kworker/u8:0.0 00000100:00080000:1.0:1736366599.503919:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366599.503923:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366599.503928:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013084480:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366599.503939:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366599.503943:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366599.503946:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17284c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013084608:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366599.503957:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366599.503961:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366599.503964:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013084736:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366599.503975:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366599.503978:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366599.503981:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013084928:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366599.705384:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366600.707402:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366601.709398:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366602.255433:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9c84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013084992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366602.255501:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366602.255602:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013084992 00000100:00100000:0.0:1736366602.255717:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6032 00000100:00100000:0.0:1736366602.255727:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc34740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013084992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366602.255767:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366602.255842:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc34740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013084992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366602.255851:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6032 00000100:00100000:1.0:1736366602.255886:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9c84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013084992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366602.271372:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736366602.271391:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013085056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366602.271433:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366602.271504:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085056 00000100:00100000:2.0:1736366602.271569:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6033 00000100:00100000:2.0:1736366602.271577:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013085056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366602.271606:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366602.271704:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013085056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366602.271712:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013085056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366602.271716:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6033 00010000:00010000:1.0:1736366602.711418:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366603.713396:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366604.288129:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366604.288214:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366604.288260:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031808 00000100:00100000:0.0:1736366604.288268:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366604.288300:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031936 00000100:00100000:0.0:1736366604.288312:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041031872 00000100:00100000:3.0:1736366604.288314:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 355 00000100:00100000:3.0:1736366604.288321:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041031808:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366604.288356:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 945 00000100:00100000:0.0:1736366604.288365:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a56f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041031936:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366604.288374:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1234 00000100:00100000:2.0:1736366604.288380:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041031872:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:3.0:1736366604.288393:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041031808:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 71us (270us total) trans 0 rc 0/0 00010000:02000000:2.0:1736366604.288399:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366604.288401:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 355 00000100:00100000:0.0:1736366604.288421:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a56f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041031936:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 56us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366604.288431:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041031872:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 50us (165us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366604.288432:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 945 00000100:00100000:2.0:1736366604.288440:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1234 00000100:00080000:2.0:1736366604.511322:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366604.511330:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366604.511334:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366604.511340:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8947 00000100:00080000:2.0:1736366604.511344:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366604.511351:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366604.511372:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013085120:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366604.511375:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172af80 x1820703013085184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366604.511426:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736366604.511427:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366604.511431:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366604.511433:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366604.511437:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8947 00000100:00080000:2.0:1736366604.511440:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366604.511457:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366604.511476:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a1728980 x1820703013085312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366604.511480:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085120 00000100:00100000:0.0:1736366604.511486:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1736366604.511497:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013085248:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366604.511499:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366604.511503:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013085184:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366604.511504:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366604.511505:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366604.511510:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8947 00000100:00080000:2.0:1736366604.511512:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366604.511516:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366604.511516:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1736366604.511521:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013085120:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366604.511531:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a1728e40 x1820703013085440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366604.511532:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366604.511551:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366604.511559:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013085376:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366604.511567:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366604.511571:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366604.511573:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366604.511578:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8947 00000100:00080000:2.0:1736366604.511580:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 21s 00000100:00100000:3.0:1736366604.511581:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013085120:12345-0@lo:400:kworker/u8:0.0 Request processed in 59us (155us total) trans 0 rc 0/0 00000100:00080000:2.0:1736366604.511584:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366604.511588:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1736366604.511590:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013085312:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366604.511592:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366604.511597:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172e880 x1820703013085632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366604.511647:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366604.511648:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013085504:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366604.511675:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085248 00000100:00100000:1.0:1736366604.511675:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1728e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013085440:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366604.511676:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366604.511695:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085184 00000100:00100000:3.0:1736366604.511697:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1736366604.511702:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013085568:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366604.511706:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085376 00000100:00100000:1.0:1736366604.511709:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366604.511715:0:25142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085312 00000100:00100000:3.0:1736366604.511721:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366604.511722:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:1.0:1736366604.511726:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013085632:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366604.511729:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136939300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013085248:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366604.511731:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:2.0:1736366604.511736:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013085376:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366604.511745:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085504 00000100:00100000:1.0:1736366604.511750:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366604.511766:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085568 00000100:00100000:3.0:1736366604.511780:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7387 00000100:00100000:3.0:1736366604.511784:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9caf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013085504:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366604.511785:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136939300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013085248:12345-0@lo:400:kworker/u8:0.0 Request processed in 56us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366604.511786:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085440 00000100:00100000:2.0:1736366604.511796:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013085376:12345-0@lo:400:kworker/u8:0.0 Request processed in 59us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366604.511805:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:1.0:1736366604.511807:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77151 00000100:00100000:1.0:1736366604.511811:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc35f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013085440:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366604.511813:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:3.0:1736366604.511815:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9caf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013085504:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (140us total) trans 0 rc 0/0 00010000:02000000:1.0:1736366604.511823:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366604.511829:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085632 00000100:00100000:3.0:1736366604.511832:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7387 00000100:00100000:2.0:1736366604.511840:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1736366604.511844:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:2.0:1736366604.511845:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc34c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013085184:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366604.511845:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7388 00000100:00100000:0.0:1736366604.511849:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013085312:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366604.511850:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013085568:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366604.511851:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc35f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013085440:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (142us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366604.511857:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77151 00010000:02000000:0.0:1736366604.511858:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366604.511858:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366604.511881:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013085568:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (161us total) trans 0 rc 0/0 00000100:00080000:1.0:1736366604.511887:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366604.511887:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7388 00000100:00080000:1.0:1736366604.511891:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366604.511895:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1728e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013085440:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366604.511897:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3322:x1820703013085312:12345-0@lo:38:kworker/u8:0.0 Request processed in 46us (251us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366604.511897:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc34c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013085184:12345-0@lo:38:kworker/u8:0.0 Request processed in 51us (346us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366604.511904:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366604.511906:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366604.511906:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:1.0:1736366604.511908:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013085184:0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366604.511917:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366604.511921:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:3.0:1736366604.511922:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013085568:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366604.511925:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00080000:1.0:1736366604.511927:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366604.511930:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc376c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013085632:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366604.511931:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013085312:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366604.511931:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013085504:0@lo:400:kworker/u8:0.0 00010000:02000000:2.0:1736366604.511939:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366604.511961:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013085376:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366604.511976:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013085248:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366604.511978:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc376c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013085632:12345-0@lo:38:kworker/u8:0.0 Request processed in 47us (227us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366604.511986:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00080000:1.0:1736366604.511994:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366604.511997:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366604.512000:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013085632:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366604.512016:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013085120:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1736366604.715402:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366605.717372:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366606.719344:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1736366607.263451:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736366607.263476:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc30980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013085696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366607.263552:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366607.263685:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085696 00000100:00100000:0.0:1736366607.263748:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6034 00000100:00100000:0.0:1736366607.263756:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013085696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366607.263795:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366607.263867:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013085696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366607.263880:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6034 00000100:00100000:2.0:1736366607.263937:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012cc30980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013085696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1736366607.279361:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136939c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013085760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366607.279408:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366607.279476:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085760 00000100:00100000:0.0:1736366607.279508:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6035 00000100:00100000:0.0:1736366607.279515:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a17284c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013085760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1736366607.279542:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:0.0:1736366607.279622:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a17284c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013085760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366607.279656:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6035 00000100:00100000:2.0:1736366607.279669:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136939c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013085760:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366607.721393:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366608.723347:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366609.296024:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366609.296084:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366609.296130:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032000 00000100:00100000:0.0:1736366609.296143:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366609.296213:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032128 00000100:00100000:2.0:1736366609.296248:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 357 00000100:00100000:2.0:1736366609.296260:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041032000:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366609.296267:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032064 00000100:00100000:3.0:1736366609.296279:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 948 00000100:00100000:3.0:1736366609.296287:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041032128:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366609.296296:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1238 00000100:00100000:1.0:1736366609.296302:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041032064:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:1.0:1736366609.296319:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366609.296339:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041032000:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 80us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366609.296341:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041032128:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 55us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366609.296349:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 948 00000100:00100000:1.0:1736366609.296357:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041032064:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 55us (216us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366609.296362:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 357 00000100:00100000:1.0:1736366609.296364:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1238 00000100:00100000:0.0:1736366609.375770:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:1.0:1736366609.375895:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032192 00000100:00100000:1.0:1736366609.375941:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1239 00000100:00100000:1.0:1736366609.375947:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136938980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041032192:12345-192.168.201.2@tcp:17:kworker/0:0.0 00000100:00100000:1.0:1736366609.376020:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136938980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041032192:12345-192.168.201.2@tcp:17:kworker/0:0.0 Request processed in 73us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366609.376027:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1239 00000100:00080000:2.0:1736366609.519319:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366609.519327:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366609.519331:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366609.519339:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8952 00000100:00080000:2.0:1736366609.519344:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366609.519350:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366609.519374:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a1729c80 x1820703013085888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366609.519380:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1736366609.519398:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013085824:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366609.519420:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366609.519425:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366609.519427:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736366609.519429:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1736366609.519431:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8952 00000100:00080000:2.0:1736366609.519434:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:2.0:1736366609.519438:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366609.519447:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013085952:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366609.519452:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172ed40 x1820703013086016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366609.519459:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366609.519479:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366609.519483:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366609.519485:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366609.519489:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8952 00000100:00080000:2.0:1736366609.519492:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 11s 00000100:00100000:3.0:1736366609.519492:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366609.519496:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366609.519508:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1729c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013085888:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366609.519510:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736366609.519510:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172e880 x1820703013086144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366609.519520:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013086080:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366609.519580:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085824 00000100:00100000:1.0:1736366609.519593:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366609.519600:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1736366609.519600:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366609.519605:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366609.519606:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1736366609.519608:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1736366609.519609:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013086208:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366609.519611:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8952 00000100:00080000:2.0:1736366609.519614:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 6s 00000100:00100000:3.0:1736366609.519614:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013085824:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366609.519618:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366609.519630:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013086016:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366609.519632:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a1728980 x1820703013086336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366609.519643:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366609.519654:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013085824:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366609.519663:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1736366609.519665:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366609.519679:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086208 00000100:00100000:2.0:1736366609.519680:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085952 00000100:00100000:1.0:1736366609.519706:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013086144:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366609.519710:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013085888 00000100:00100000:0.0:1736366609.519713:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7389 00000100:00100000:0.0:1736366609.519720:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013693df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013086208:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366609.519727:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086016 00000100:00100000:1.0:1736366609.519739:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366609.519741:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013086272:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366609.519742:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:2.0:1736366609.519748:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9caac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013085952:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366609.519758:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013086336:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366609.519768:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366609.519775:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013693df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013086208:12345-0@lo:400:kworker/u8:0.0 Request processed in 55us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366609.519786:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7389 00000100:00100000:3.0:1736366609.519803:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3323:1820703013085952:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366609.519804:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366609.519809:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086272 00000100:00100000:2.0:1736366609.519812:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9caac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3323:x1820703013085952:12345-0@lo:400:kworker/u8:0.0 Request processed in 63us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366609.519821:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1736366609.519832:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7390 00000100:00100000:1.0:1736366609.519834:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086336 00000100:00100000:0.0:1736366609.519837:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013086272:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366609.519838:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:2.0:1736366609.519842:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc304c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013085888:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366609.519852:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00010000:02000000:2.0:1736366609.519855:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366609.519859:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc32600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013086016:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366609.519859:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1736366609.519864:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc31c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013086336:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366609.519870:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1736366609.519875:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1736366609.519879:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013086272:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366609.519888:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7390 00000100:00100000:2.0:1736366609.519890:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc304c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013085888:12345-0@lo:38:kworker/u8:0.0 Request processed in 47us (300us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366609.519898:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1736366609.519904:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc32600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013086016:12345-0@lo:38:kworker/u8:0.0 Request processed in 47us (242us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366609.519905:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc31c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013086336:12345-0@lo:38:kworker/u8:0.0 Request processed in 41us (102us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366609.519911:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:3.0:1736366609.519914:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:0.0:1736366609.519927:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366609.519932:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086144 00000100:00080000:2.0:1736366609.519936:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1736366609.519939:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013086272:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366609.519941:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366609.519945:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013086336:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366609.519947:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77152 00000100:00100000:1.0:1736366609.519951:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013086144:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:1.0:1736366609.519957:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366609.519958:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086080 00000100:00100000:0.0:1736366609.519966:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013086208:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366609.519972:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366609.519974:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366609.519975:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:1.0:1736366609.519977:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013086144:12345-0@lo:38:kworker/u8:0.0 Request processed in 26us (240us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366609.519978:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1729c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013085888:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366609.519979:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136938e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013086080:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366609.519983:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77152 00000100:00080000:2.0:1736366609.519992:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1736366609.519994:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013085824:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366609.519995:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366609.519999:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013086016:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366609.520010:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136938e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013086080:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366609.520016:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:0.0:1736366609.520022:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013086080:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366609.520026:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1736366609.520029:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:2.0:1736366609.520033:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013086144:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366609.725391:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366610.727375:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366611.729342:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366612.271388:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013086400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366612.271461:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366612.271552:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086400 00000100:00100000:2.0:1736366612.271618:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6036 00000100:00100000:2.0:1736366612.271626:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136939c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013086400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366612.271666:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366612.271728:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136939c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013086400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366612.271739:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6036 00000100:00100000:0.0:1736366612.271759:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013086400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366612.287366:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013086464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366612.287413:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366612.287520:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086464 00000100:00100000:2.0:1736366612.287565:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6037 00000100:00100000:2.0:1736366612.287572:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d60e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013086464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366612.287600:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366612.287646:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d60e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013086464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366612.287669:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013086464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1736366612.287677:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6037 00010000:00010000:1.0:1736366612.731385:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366613.733421:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366614.303964:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366614.304025:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366614.304085:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366614.304102:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032256 00000100:00100000:0.0:1736366614.304135:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032384 00000100:00100000:3.0:1736366614.304151:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 359 00000100:00100000:3.0:1736366614.304158:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041032256:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366614.304205:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032320 00000100:00100000:0.0:1736366614.304222:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 951 00000100:00100000:0.0:1736366614.304228:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d66d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041032384:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366614.304240:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1243 00000100:00100000:2.0:1736366614.304248:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d62140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041032320:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:2.0:1736366614.304265:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366614.304267:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1875:x1820703041032256:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 109us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366614.304271:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d66d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1874:x1820703041032384:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 43us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366614.304275:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 359 00000100:00100000:0.0:1736366614.304278:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 951 00000100:00100000:2.0:1736366614.304305:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d62140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:1873:x1820703041032320:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 58us (223us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366614.304313:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1243 00000100:00080000:2.0:1736366614.527315:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366614.527321:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366614.527324:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366614.527330:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8957 00000100:00080000:2.0:1736366614.527333:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736366614.527338:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366614.527355:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a1728980 x1820703013086592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366614.527372:0:3325:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1736366614.527389:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1729c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013086528:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366614.527391:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366614.527395:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366614.527396:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366614.527399:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8957 00000100:00080000:2.0:1736366614.527401:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736366614.527404:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366614.527412:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172af80 x1820703013086720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366614.527417:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1736366614.527425:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1736366614.527432:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366614.527434:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1728e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013086784:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366614.527437:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366614.527475:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366614.527480:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8957 00000100:00080000:2.0:1736366614.527484:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736366614.527488:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366614.527503:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366614.527503:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013086592:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366614.527507:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a17297c0 x1820703013086848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366614.527520:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086528 00000100:00100000:1.0:1736366614.527524:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013086656:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366614.527549:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00080000:2.0:1736366614.527549:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366614.527551:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366614.527554:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013086528:12345-0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366614.527554:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366614.527556:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366614.527561:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8957 00000100:00080000:2.0:1736366614.527563:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 11s 00000100:00080000:2.0:1736366614.527566:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:3.0:1736366614.527573:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366614.527577:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172b440 x1820703013087040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366614.527580:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013086976:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366614.527601:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013086528:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366614.527606:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086784 00000100:00100000:0.0:1736366614.527608:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1736366614.527611:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013086720:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366614.527617:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366614.527631:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086656 00000100:00100000:3.0:1736366614.527632:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366614.527641:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086592 00000100:00100000:1.0:1736366614.527645:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1736366614.527645:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086720 00000100:00100000:1.0:1736366614.527651:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013086912:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366614.527651:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013086848:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366614.527652:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:0.0:1736366614.527656:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc36880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013086784:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366614.527670:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:3.0:1736366614.527671:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366614.527673:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366614.527675:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc30980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013086656:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366614.527683:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013087040:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366614.527688:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc36880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3324:x1820703013086784:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366614.527694:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:1.0:1736366614.527699:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086976 00000100:00100000:3.0:1736366614.527700:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366614.527705:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087040 00000100:00100000:0.0:1736366614.527714:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1736366614.527717:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013086592:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366614.527723:0:24517:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086912 00000100:00100000:2.0:1736366614.527723:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc30980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013086656:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (171us total) trans 0 rc 0/0 00010000:02000000:0.0:1736366614.527727:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366614.527728:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:2.0:1736366614.527732:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:3.0:1736366614.527733:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9ca140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013086720:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366614.527737:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7391 00000100:00100000:1.0:1736366614.527742:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc33900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013086976:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:3.0:1736366614.527745:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366614.527747:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:0.0:1736366614.527749:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013086592:12345-0@lo:38:kworker/u8:0.0 Request processed in 31us (178us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366614.527750:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013087040:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366614.527755:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00010000:02000000:2.0:1736366614.527760:0:25140:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366614.527780:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc33900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013086976:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366614.527780:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9ca140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013086720:12345-0@lo:38:kworker/u8:0.0 Request processed in 46us (147us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366614.527785:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1728e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3324:1820703013086784:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366614.527786:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7391 00000100:00100000:3.0:1736366614.527790:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1736366614.527796:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013086656:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366614.527796:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3322:x1820703013087040:12345-0@lo:38:kworker/u8:0.0 Request processed in 45us (96us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366614.527799:0:24517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7392 00000100:00100000:1.0:1736366614.527802:0:24517:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013086912:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366614.527803:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1736366614.527820:0:24517:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013086912:12345-0@lo:400:kworker/u8:0.0 Request processed in 17us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366614.527823:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1729c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013086528:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366614.527825:0:24517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7392 00000100:00100000:3.0:1736366614.527825:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013086848 00000100:00080000:0.0:1736366614.527844:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366614.527847:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366614.527850:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013087040:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366614.527854:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77153 00000100:00100000:1.0:1736366614.527855:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013086912:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366614.527860:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cb440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013086848:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366614.527863:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013086976:0@lo:400:kworker/u8:0.0 00010000:02000000:3.0:1736366614.527871:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1736366614.527872:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366614.527874:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366614.527877:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013086592:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366614.527884:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366614.527886:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366614.527888:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013086720:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366614.527905:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cb440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013086848:12345-0@lo:38:kworker/u8:0.0 Request processed in 45us (233us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736366614.527909:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366614.527911:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366614.527912:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77153 00000100:00100000:0.0:1736366614.527913:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013086848:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366614.735387:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366615.737395:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366616.739431:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366617.279478:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013087104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366617.279548:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366617.279702:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087104 00000100:00100000:2.0:1736366617.279768:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6038 00000100:00100000:2.0:1736366617.279774:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cf200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013087104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366617.279806:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366617.279870:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cf200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013087104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366617.279878:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6038 00000100:00100000:3.0:1736366617.279918:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013087104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366617.295382:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013087168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366617.295459:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366617.295587:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087168 00000100:00100000:2.0:1736366617.295635:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6039 00000100:00100000:2.0:1736366617.295641:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a3900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013087168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366617.295665:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366617.295718:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a3900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013087168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366617.295725:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6039 00000100:00100000:1.0:1736366617.295758:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013087168:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366617.741469:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366618.743403:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366619.311873:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366619.311917:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366619.311953:0:3318:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366619.311991:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032576 00000100:00100000:2.0:1736366619.312008:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032448 00000100:00100000:0.0:1736366619.312025:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032512 00000100:00100000:3.0:1736366619.312039:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 954 00000100:00100000:3.0:1736366619.312049:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d67200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1875:x1820703041032576:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1736366619.312051:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1247 00000100:00100000:2.0:1736366619.312051:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 361 00000100:00100000:0.0:1736366619.312057:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d604c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041032512:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00000100:00100000:2.0:1736366619.312058:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1874:x1820703041032448:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00010000:02000000:0.0:1736366619.312072:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:2.0:1736366619.312118:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1874:x1820703041032448:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 60us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366619.312120:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d67200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1875:x1820703041032576:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 73us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366619.312124:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d604c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041032512:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 66us (171us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366619.312126:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 361 00000100:00100000:3.0:1736366619.312127:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 954 00000100:00100000:0.0:1736366619.312132:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1247 00000100:00080000:2.0:1736366619.535318:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366619.535334:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366619.535337:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366619.535342:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8962 00000100:00080000:2.0:1736366619.535345:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736366619.535350:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366619.535404:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172c740 x1820703013087296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366619.535427:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366619.535431:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366619.535432:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366619.535435:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8962 00000100:00080000:2.0:1736366619.535437:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 16s 00000100:00100000:0.0:1736366619.535440:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013087296:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366619.535440:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013087360:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366619.535440:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366619.535449:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172f200 x1820703013087424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366619.535479:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366619.535482:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366619.535483:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366619.535486:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8962 00000100:00100000:1.0:1736366619.535488:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366619.535488:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366619.535491:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366619.535496:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013087232:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366619.535501:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172af80 x1820703013087552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366619.535518:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366619.535521:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1736366619.535522:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366619.535522:0:3326:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1736366619.535528:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013087680:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366619.535528:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366619.535531:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8962 00000100:00080000:2.0:1736366619.535533:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 16s 00000100:00080000:2.0:1736366619.535536:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366619.535545:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172e880 x1820703013087744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366619.535565:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366619.535570:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366619.535574:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087360 00000100:00100000:3.0:1736366619.535579:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013087488:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366619.535587:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013087424:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366619.535594:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087680 00000100:00100000:2.0:1736366619.535600:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087296 00000100:00100000:0.0:1736366619.535608:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366619.535620:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013087552:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366619.535623:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087424 00000100:00100000:1.0:1736366619.535625:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7393 00000100:00100000:3.0:1736366619.535626:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366619.535630:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013087680:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366619.535639:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366619.535643:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087488 00000100:00100000:0.0:1736366619.535652:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013087744:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366619.535654:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:3.0:1736366619.535655:0:3323:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1736366619.535659:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013087360:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366619.535661:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013087616:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366619.535669:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013087680:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366619.535670:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366619.535675:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7393 00000100:00100000:3.0:1736366619.535683:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366619.535694:0:26348:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087744 00000100:00100000:1.0:1736366619.535702:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087616 00000100:00100000:2.0:1736366619.535707:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3326:x1820703013087360:12345-0@lo:400:kworker/u8:0.0 Request processed in 48us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366619.535710:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:2.0:1736366619.535714:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1736366619.535716:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013087488:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366619.535719:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7394 00000100:00100000:3.0:1736366619.535722:0:25142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1736366619.535723:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9c8980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013087616:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366619.535727:0:25142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d64c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013087296:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366619.535728:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:2.0:1736366619.535731:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d65f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013087424:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:3.0:1736366619.535739:0:25142:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1736366619.535740:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366619.535758:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c8980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013087616:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366619.535763:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9c84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3323:x1820703013087488:12345-0@lo:400:kworker/u8:0.0 Request processed in 47us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366619.535764:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7394 00000100:00100000:0.0:1736366619.535769:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:2.0:1736366619.535777:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d65f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013087424:12345-0@lo:38:kworker/u8:0.0 Request processed in 45us (169us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366619.535779:0:25142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d64c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1820703013087296:12345-0@lo:38:kworker/u8:0.0 Request processed in 51us (209us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366619.535784:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1736366619.535787:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d61300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013087744:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366619.535788:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1736366619.535791:0:25142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00010000:02000000:0.0:1736366619.535796:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366619.535806:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013087680:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366619.535815:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087552 00000100:00100000:0.0:1736366619.535816:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d61300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013087744:12345-0@lo:38:kworker/u8:0.0 Request processed in 28us (146us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366619.535816:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3326:1820703013087360:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366619.535821:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087232 00000100:00100000:0.0:1736366619.535822:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1736366619.535833:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77154 00000100:00100000:3.0:1736366619.535836:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d63440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013087552:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366619.535837:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1736366619.535841:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013087232:12345-0@lo:400:kworker/u8:0.0 00010000:02000000:3.0:1736366619.535843:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1736366619.535851:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366619.535854:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366619.535857:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013087424:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366619.535863:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d63440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013087552:12345-0@lo:38:kworker/u8:0.0 Request processed in 25us (224us total) trans 0 rc -19/-19 00000100:00080000:0.0:1736366619.535865:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366619.535868:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366619.535869:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77154 00000100:00100000:0.0:1736366619.535870:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013087552:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366619.535870:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3325:x1820703013087232:12345-0@lo:400:kworker/u8:0.0 Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366619.535876:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00080000:0.0:1736366619.535888:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366619.535890:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366619.535893:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013087744:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366619.535895:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3325:1820703013087232:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366619.535895:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013087616:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366619.535903:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366619.535905:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:3.0:1736366619.535905:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3323:1820703013087488:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366619.535907:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013087296:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366619.745423:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366620.747414:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366621.749432:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1736366622.287457:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f9cc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013087808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366622.287524:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366622.287669:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087808 00000100:00100000:2.0:1736366622.287730:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6040 00000100:00100000:2.0:1736366622.287736:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a5580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013087808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1736366622.287767:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:2.0:1736366622.287828:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a5580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013087808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366622.287835:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6040 00000100:00100000:1.0:1736366622.287869:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f9cc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013087808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1736366622.303479:0:3324:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1736366622.303499:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880095d676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013087872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1736366622.303545:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366622.303673:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087872 00000100:00100000:2.0:1736366622.303722:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6041 00000100:00100000:2.0:1736366622.303728:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013087872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366622.303751:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366622.303805:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013087872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366622.303812:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6041 00000100:00100000:1.0:1736366622.303844:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880095d676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013087872:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366622.751455:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366623.753485:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366624.320076:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366624.320124:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366624.320203:0:3316:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:3.0:1736366624.320230:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032640 00000100:00100000:2.0:1736366624.320265:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032768 00000100:00100000:3.0:1736366624.320329:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 363 00000100:00100000:2.0:1736366624.320337:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032704 00000100:00100000:3.0:1736366624.320337:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1874:x1820703041032640:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366624.320356:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 957 00000100:00100000:2.0:1736366624.320368:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1251 00000100:00100000:1.0:1736366624.320370:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1875:x1820703041032768:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366624.320374:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041032704:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:2.0:1736366624.320392:0:25141:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:3.0:1736366624.320413:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1874:x1820703041032640:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 77us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366624.320421:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 363 00000100:00100000:1.0:1736366624.320434:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1875:x1820703041032768:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 68us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366624.320440:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:1873:x1820703041032704:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 66us (238us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366624.320443:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 957 00000100:00100000:2.0:1736366624.320447:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1251 00000100:00080000:2.0:1736366624.543351:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366624.543357:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366624.543360:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366624.543378:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8967 00000100:00080000:2.0:1736366624.543382:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366624.543387:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366624.543407:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a1729c80 x1820703013088000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366624.543417:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013087936:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366624.543443:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366624.543447:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366624.543448:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366624.543451:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8967 00000100:00080000:2.0:1736366624.543453:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366624.543456:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366624.543463:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a1728e40 x1820703013088128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366624.543473:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366624.543477:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736366624.543478:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013088064:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366624.543480:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366624.543481:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366624.543484:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8967 00000100:00080000:2.0:1736366624.543486:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366624.543488:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366624.543496:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a17297c0 x1820703013088256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366624.543512:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013088192:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366624.543520:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1736366624.543521:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366624.543523:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366624.543524:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366624.543527:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8967 00000100:00080000:2.0:1736366624.543534:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1736366624.543535:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1729c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013088000:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366624.543538:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013088384:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366624.543538:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366624.543548:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172af80 x1820703013088448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1736366624.543561:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366624.543569:0:16269:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013087936 00000100:00100000:2.0:1736366624.543573:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013088320:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366624.543577:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366624.543588:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088384 00000100:00100000:3.0:1736366624.543596:0:16269:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1736366624.543601:0:16269:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013087936:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366624.543602:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1728e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013088128:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366624.543612:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366624.543616:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7395 00000100:00100000:0.0:1736366624.543619:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366624.543621:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013088384:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366624.543637:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013088256:0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366624.543646:0:16269:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3324:x1820703013087936:12345-0@lo:400:kworker/u8:0.0 Request processed in 44us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366624.543652:0:16269:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1736366624.543654:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088064 00000100:00100000:1.0:1736366624.543658:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3324:x1820703013088384:12345-0@lo:400:kworker/u8:0.0 Request processed in 37us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366624.543661:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1736366624.543664:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7395 00000100:00100000:2.0:1736366624.543677:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088000 00000100:00100000:0.0:1736366624.543678:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013088448:0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366624.543679:0:29930:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088320 00000100:00100000:3.0:1736366624.543679:0:24903:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088256 00000100:00100000:2.0:1736366624.543688:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088128 00000100:00100000:1.0:1736366624.543693:0:29930:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7396 00000100:00100000:0.0:1736366624.543695:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366624.543695:0:24903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77155 00000100:00100000:1.0:1736366624.543696:0:29930:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a172f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013088320:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366624.543698:0:24903:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d65580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013088256:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366624.543699:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088448 00000100:00100000:2.0:1736366624.543707:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00010000:02000000:3.0:1736366624.543709:0:24903:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366624.543712:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9ca600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013088064:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366624.543724:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1736366624.543724:0:29930:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a172f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013088320:12345-0@lo:400:kworker/u8:0.0 Request processed in 27us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366624.543729:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d676c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013088000:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366624.543730:0:29930:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7396 00000100:00100000:3.0:1736366624.543738:0:24903:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d65580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013088256:12345-0@lo:38:kworker/u8:0.0 Request processed in 39us (77us total) trans 0 rc -19/-19 00010000:02000000:0.0:1736366624.543740:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366624.543744:0:24903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77155 00000100:00100000:1.0:1736366624.543749:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366624.543753:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9ca600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3325:x1820703013088064:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366624.543760:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:0.0:1736366624.543767:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d676c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013088000:12345-0@lo:38:kworker/u8:0.0 Request processed in 38us (190us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366624.543772:0:25141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088192 00000100:00100000:0.0:1736366624.543773:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:3.0:1736366624.543775:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3325:1820703013088064:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366624.543781:0:25141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:2.0:1736366624.543785:0:25141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013088192:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366624.543789:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:1.0:1736366624.543793:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d650c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013088128:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366624.543802:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1736366624.543802:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3324:1820703013088384:0@lo:400:kworker/u8:0.0 00010000:02000000:1.0:1736366624.543804:0:26348:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366624.543809:0:25141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3326:x1820703013088192:12345-0@lo:400:kworker/u8:0.0 Request processed in 23us (59us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366624.543814:0:25141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:0.0:1736366624.543816:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086933440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013088448:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:3.0:1736366624.543823:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3324:1820703013087936:0@lo:400:kworker/u8:0.0 00010000:02000000:0.0:1736366624.543824:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1736366624.543827:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d650c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3322:x1820703013088128:12345-0@lo:38:kworker/u8:0.0 Request processed in 33us (207us total) trans 0 rc -19/-19 00000100:00100000:1.0:1736366624.543832:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:0.0:1736366624.543849:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086933440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013088448:12345-0@lo:38:kworker/u8:0.0 Request processed in 33us (153us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366624.543853:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013088320:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366624.543854:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1736366624.543860:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3326:1820703013088192:0@lo:400:kworker/u8:0.0 00000100:00080000:0.0:1736366624.543881:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366624.543884:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366624.543888:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013088448:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366624.543895:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366624.543897:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366624.543899:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1729c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013088000:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366624.543907:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366624.543908:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366624.543910:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1728e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013088128:0@lo:38:kworker/u8:0.0 00000100:00080000:0.0:1736366624.543917:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1736366624.543919:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366624.543921:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013088256:0@lo:38:kworker/u8:0.0 00010000:00010000:3.0:1736366624.755430:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366625.757499:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366626.759529:0:10475:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1736366627.295524:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a3440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013088512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1736366627.295594:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366627.295663:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088512 00000100:00100000:0.0:1736366627.295730:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6042 00000100:00100000:0.0:1736366627.295735:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f9cc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013088512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1736366627.295768:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 219904 pending 0 free 3906641920 avail 3675119616 00000100:00100000:0.0:1736366627.295830:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f9cc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3325:x1820703013088512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366627.295838:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6042 00000100:00100000:3.0:1736366627.295878:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a3440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3325:1820703013088512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1736366627.311434:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800797a0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013088576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1736366627.311476:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366627.311602:0:22854:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088576 00000100:00100000:2.0:1736366627.311655:0:22854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6043 00000100:00100000:2.0:1736366627.311660:0:22854:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869363c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013088576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1736366627.311695:0:22854:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923435520 avail 3691913216 00000100:00100000:2.0:1736366627.311744:0:22854:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869363c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013088576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366627.311751:0:22854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6043 00000100:00100000:0.0:1736366627.311763:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800797a0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013088576:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1736366627.761431:0:14340:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1736366628.763461:0:6822:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1736366629.328225:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366629.328285:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:0.0:1736366629.328326:0:3317:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.2@tcp (source: 12345-192.168.201.2@tcp) 00000100:00100000:2.0:1736366629.328370:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032960 00000100:00100000:3.0:1736366629.328370:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032832 00000100:00100000:2.0:1736366629.328417:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703041032896 00000100:00100000:3.0:1736366629.328423:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 365 00000100:00100000:1.0:1736366629.328428:0:26348:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 960 00000100:00100000:3.0:1736366629.328434:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1874:x1820703041032832:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1736366629.328437:0:26348:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869350c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1875:x1820703041032960:12345-192.168.201.2@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1736366629.328444:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.2@tcp, seq: 1255 00000100:00100000:2.0:1736366629.328450:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086934c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041032896:12345-192.168.201.2@tcp:38:kworker/u8:0.0 00010000:02000000:2.0:1736366629.328466:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.2@tcp (stopping) 00000100:00100000:1.0:1736366629.328527:0:26348:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869350c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b+6:1875:x1820703041032960:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 91us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1736366629.328535:0:26348:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 960 00000100:00100000:2.0:1736366629.328538:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086934c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:1873:x1820703041032896:12345-192.168.201.2@tcp:38:kworker/u8:0.0 Request processed in 86us (212us total) trans 0 rc -19/-19 00000100:00100000:3.0:1736366629.328540:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fca5ad9b-3bb3-4a62-9968-f2872966692c+9:1874:x1820703041032832:12345-192.168.201.2@tcp:400:kworker/u8:0.0 Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366629.328545:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 1255 00000100:00100000:3.0:1736366629.328552:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.2@tcp, seq: 365 00000100:00080000:2.0:1736366629.551340:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366629.551347:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366629.551350:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366629.551356:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8972 00000100:00080000:2.0:1736366629.551359:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366629.551364:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff880129f78800 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366629.551383:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172c280 x1820703013088704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:2.0:1736366629.551411:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366629.551414:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366629.551415:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366629.551418:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8972 00000100:00080000:2.0:1736366629.551420:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366629.551437:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff880129f7b000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:0.0:1736366629.551443:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013088640:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366629.551448:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172b440 x1820703013088832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366629.551452:0:3324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013088768:0@lo:400:kworker/u8:0.0 00000100:00080000:2.0:1736366629.551473:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1736366629.551475:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013088704:0@lo:38:kworker/u8:0.0 00000100:00080000:2.0:1736366629.551476:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366629.551477:0:18180:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366629.551480:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8972 00000100:00080000:2.0:1736366629.551482:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 21s 00000100:00080000:2.0:1736366629.551484:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8800918c9000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:2.0:1736366629.551492:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a1728e40 x1820703013088960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1736366629.551496:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366629.551500:0:3324:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1736366629.551511:0:18180:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1736366629.551514:0:18180:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1736366629.551515:0:18180:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1736366629.551518:0:18180:0:(import.c:534:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8972 00000100:00080000:2.0:1736366629.551520:0:18180:0:(import.c:581:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1736366629.551522:0:18180:0:(import.c:615:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff880086b63000 using connection 192.168.201.102@tcp/0@lo 00000100:00100000:1.0:1736366629.551523:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366629.551529:0:3323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013089088:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366629.551529:0:18180:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800a172c740 x1820703013089152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1736366629.551541:0:3325:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013088896:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366629.551549:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013088832:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366629.551552:0:3323:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1736366629.551559:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088768 00000100:00100000:3.0:1736366629.551565:0:3325:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366629.551579:0:3326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1729c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013089024:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366629.551580:0:25140:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088704 00000100:00100000:2.0:1736366629.551585:0:16831:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088896 00000100:00100000:0.0:1736366629.551597:0:3326:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1736366629.551599:0:9254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013089088 00000100:00100000:2.0:1736366629.551600:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:2.0:1736366629.551605:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013088768:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366629.551617:0:25140:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:0.0:1736366629.551623:0:24520:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013089024 00000100:00100000:1.0:1736366629.551623:0:25140:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b6cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013088896:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366629.551627:0:9254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7397 00000100:00100000:3.0:1736366629.551632:0:9254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086933dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013089088:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366629.551649:0:24520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7398 00000100:00100000:0.0:1736366629.551654:0:24520:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086935f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013089024:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366629.551659:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3324:x1820703013088768:12345-0@lo:400:kworker/u8:0.0 Request processed in 53us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1736366629.551665:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:1.0:1736366629.551671:0:25140:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b6cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3325:x1820703013088896:12345-0@lo:400:kworker/u8:0.0 Request processed in 49us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366629.551675:0:9254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086933dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3323:x1820703013089088:12345-0@lo:400:kworker/u8:0.0 Request processed in 43us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366629.551681:0:9254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7397 00000100:00100000:1.0:1736366629.551688:0:25140:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:0.0:1736366629.551689:0:24520:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086935f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3326:x1820703013089024:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1736366629.551695:0:24520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7398 00000100:00100000:2.0:1736366629.551699:0:16831:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1736366629.551703:0:16831:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013088704:12345-0@lo:38:kworker/u8:0.0 00010000:02000000:2.0:1736366629.551714:0:16831:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366629.551719:0:3324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3324:1820703013088768:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366629.551724:0:3325:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3325:1820703013088896:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1736366629.551731:0:3326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1729c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3326:1820703013089024:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1736366629.551739:0:16831:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3322:x1820703013088704:12345-0@lo:38:kworker/u8:0.0 Request processed in 36us (217us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366629.551745:0:16831:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1736366629.551750:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366629.551755:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3323:1820703013089088:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1736366629.551756:0:16273:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088640 00000100:00100000:3.0:1736366629.551777:0:16273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1736366629.551780:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088832 00000100:00100000:3.0:1736366629.551780:0:16273:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013088640:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366629.551783:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1728e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013088960:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366629.551806:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1736366629.551809:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013088832:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:1.0:1736366629.551813:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:2.0:1736366629.551815:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1736366629.551817:0:16273:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5676086f-5bd9-49e5-9ff1-e2e4082ca5da+18:3323:x1820703013088640:12345-0@lo:400:kworker/u8:0.0 Request processed in 36us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1736366629.551823:0:16273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1736366629.551825:0:3323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1728980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5676086f-5bd9-49e5-9ff1-e2e4082ca5da:3323:1820703013088640:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1736366629.551827:0:3322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013089152:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366629.551837:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013088832:12345-0@lo:38:kworker/u8:0.0 Request processed in 27us (87us total) trans 0 rc -19/-19 00000100:00100000:2.0:1736366629.551842:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:1.0:1736366629.551846:0:3322:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1736366629.551850:0:9264:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013088960 00000100:00100000:2.0:1736366629.551853:0:25656:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1820703013089152 00000100:00080000:1.0:1736366629.551863:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366629.551866:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:0.0:1736366629.551869:0:9264:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77156 00000100:00100000:2.0:1736366629.551869:0:25656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1736366629.551870:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3322:1820703013088704:0@lo:38:kworker/u8:0.0 00000100:00100000:2.0:1736366629.551872:0:25656:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013089152:12345-0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366629.551873:0:9264:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797a5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013088960:12345-0@lo:38:kworker/u8:0.0 00000100:00080000:1.0:1736366629.551877:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880129f7b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:02000000:2.0:1736366629.551878:0:25656:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1736366629.551879:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366629.551882:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3322:1820703013088832:0@lo:38:kworker/u8:0.0 00010000:02000000:0.0:1736366629.551892:0:9264:0:(ldlm_lib.c:1139:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1736366629.551893:0:25656:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3322:x1820703013089152:12345-0@lo:38:kworker/u8:0.0 Request processed in 20us (48us total) trans 0 rc -19/-19 00000100:00080000:1.0:1736366629.551898:0:3322:0:(import.c:86:import_set_state_nolock()) ffff880086b63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1736366629.551899:0:25656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00080000:1.0:1736366629.551901:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366629.551903:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a172c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3322:1820703013089152:0@lo:38:kworker/u8:0.0 00000100:00100000:0.0:1736366629.551939:0:9264:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797a5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3322:x1820703013088960:12345-0@lo:38:kworker/u8:0.0 Request processed in 65us (125us total) trans 0 rc -19/-19 00000100:00100000:0.0:1736366629.551946:0:9264:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77156 00000100:00080000:1.0:1736366629.551950:0:3322:0:(import.c:86:import_set_state_nolock()) ffff8800918c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1736366629.551952:0:3322:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.102@tcp failed (-19) 00000100:00100000:1.0:1736366629.551955:0:3322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1728e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3322:1820703013088960:0@lo:38:kworker/u8:0.0 00000020:02000400:0.0:1736366629.580292:0:17953:0:(genops.c:1786:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 256 seconds. The obd refcount = 4. Is it stuck? 00000020:02000400:0.0:1736366629.585457:0:17953:0:(genops.c:1752:print_export_data()) lustre-MDT0000: UNLINKED ffff88012c763800 cb7a860d-20ab-4f8e-8b88-c5dbc4e5730b 192.168.201.2@tcp 1 (0 0 0) 1 0 1 0: (null) 536870912003 stale:0 00010000:00010000:3.0:1736366629.765465:0:8052:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1736366630.767470:0:6823:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 18918 lines, 18918 kept, 0 dropped, 0 bad.